obdiag version: 3.7.2 [2025-12-08 16:09:17.277] [DEBUG] - cmd: obdiag gather scene run [2025-12-08 16:09:17.277] [DEBUG] - opts: {'config_password': None, 'inner_config': None, 'scene': 'observer.perf_sql', 'from': None, 'to': None, 'since': '30m', 'env': "{db_connect='-h127.0.0.1 -P2881 -urd_read@woqu -pnA0(aB4}aF0^aA3}eH2~aC1} -Dcprint', trace_id='YB42C0A8001A-000644EA3E986579-0-0'}", 'store_dir': './', 'temp_dir': '/tmp', 'skip_type': None, 'c': '/root/.obdiag/config.yml', 'config': ['db_host=127.0.0.1', 'db_port=2881', 'tenant_sys.user=root@sys', 'tenant_sys.password=+]#9{Lk^ivefa[vCH0pl.m!*I%x', 'obcluster.servers.global.ssh_username=root', 'obcluster.servers.global.ssh_password=Printz8?U6e[v_gx2TP?y', 'obcluster.servers.global.home_path=/data1/myoceanbase/oceanbase'], 'redact': ''} [2025-12-08 16:09:17.277] [DEBUG] - mkdir /opt/oceanbase-diagnostic-tool/conf/inner_config.yml [2025-12-08 16:09:17.283] [INFO] obdiag version: 3.7.2 [2025-12-08 16:09:17.283] [INFO] gather_scenes_run start ... [2025-12-08 16:09:17.284] [DEBUG] - start get_observer_version_by_sql . input: 127.0.0.1:2881 [2025-12-08 16:09:17.286] [DEBUG] - connect databse ... [2025-12-08 16:09:17.288] [DEBUG] - get_observer_version_by_sql ob_version_info is ('5.7.25-OceanBase_CE-v4.4.1.0',) [2025-12-08 16:09:17.292] [DEBUG] - connect databse ... [2025-12-08 16:09:17.294] [DEBUG] - get host info: [{'ip': '192.168.0.138'}, {'ip': '192.168.0.26'}, {'ip': '192.168.0.33'}] [2025-12-08 16:09:17.294] [DEBUG] - update nodes config: [{'ip': '192.168.0.138'}, {'ip': '192.168.0.26'}, {'ip': '192.168.0.33'}] [2025-12-08 16:09:17.721] [DEBUG] - connect databse ... [2025-12-08 16:09:17.729] [INFO] gather from_time: 2025-12-08 15:39:17, to_time: 2025-12-08 16:10:17 [2025-12-08 16:09:17.729] [DEBUG] - gather scene variables: {'observer_data_dir': '/data1/myoceanbase/oceanbase', 'obproxy_data_dir': '', 'from_time': '2025-12-08 15:39:17', 'to_time': '2025-12-08 16:10:17'} [2025-12-08 16:09:17.729] [DEBUG] - Use /root/obdiag_gather_pack_20251208160917 as pack dir. [2025-12-08 16:09:17.730] [DEBUG] - mkdir /root/obdiag_gather_pack_20251208160917 [2025-12-08 16:09:17.752] [DEBUG] - execute_tasks. the number of tasks is 1 ,tasks is dict_keys(['observer.base']) [2025-12-08 16:09:17.753] [INFO] execute tasks: observer.base [2025-12-08 16:09:17.753] [DEBUG] - get observer version, by sql [2025-12-08 16:09:17.753] [DEBUG] - start get_observer_version_by_sql . input: 127.0.0.1:2881 [2025-12-08 16:09:17.755] [DEBUG] - connect databse ... [2025-12-08 16:09:17.757] [DEBUG] - get_observer_version_by_sql ob_version_info is ('5.7.25-OceanBase_CE-v4.4.1.0',) [2025-12-08 16:09:17.757] [DEBUG] - observer.base execute! [2025-12-08 16:09:17.758] [DEBUG] - version_int is 4.4.1.0 steps_versions is [2.0.0.0, 3.9.9.9] [2025-12-08 16:09:17.758] [DEBUG] - minVersion is 2.0.0.0, maxVersion is 3.9.9.9 [2025-12-08 16:09:17.758] [DEBUG] - version_int is 4.4.1.0 steps_versions is [4.0.0.0, *] [2025-12-08 16:09:17.758] [DEBUG] - minVersion is 4.0.0.0, maxVersion is 999 [2025-12-08 16:09:17.758] [DEBUG] - filter_by_version is return 1 [2025-12-08 16:09:17.758] [INFO] run scene excute yaml mode in node: 192.168.0.138 start [2025-12-08 16:09:17.758] [DEBUG] - step nu: 1 [2025-12-08 16:09:17.758] [DEBUG] - step nu: 1 initted, to execute [2025-12-08 16:09:17.759] [DEBUG] - step: {'type': 'sql', 'sql': "show variables like 'version_comment';", 'global': True} [2025-12-08 16:09:17.761] [DEBUG] - connect databse ... [2025-12-08 16:09:17.762] [DEBUG] - StepSQLHandler execute: show variables like 'version_comment'; [2025-12-08 16:09:17.766] [DEBUG] - step nu: 1 execute end [2025-12-08 16:09:17.766] [DEBUG] - step nu: 2 [2025-12-08 16:09:17.766] [DEBUG] - step nu: 2 initted, to execute [2025-12-08 16:09:17.766] [DEBUG] - step: {'type': 'sql', 'sql': 'SELECT * FROM oceanbase.DBA_OB_ZONES ORDER BY ZONE;', 'global': True} [2025-12-08 16:09:17.768] [DEBUG] - connect databse ... [2025-12-08 16:09:17.770] [DEBUG] - StepSQLHandler execute: SELECT * FROM oceanbase.DBA_OB_ZONES ORDER BY ZONE; [2025-12-08 16:09:17.773] [DEBUG] - step nu: 2 execute end [2025-12-08 16:09:17.773] [DEBUG] - step nu: 3 [2025-12-08 16:09:17.773] [DEBUG] - step nu: 3 initted, to execute [2025-12-08 16:09:17.773] [DEBUG] - step: {'type': 'sql', 'sql': 'SELECT * FROM oceanbase.DBA_OB_SERVERS ORDER BY ZONE;', 'global': True} [2025-12-08 16:09:17.776] [DEBUG] - connect databse ... [2025-12-08 16:09:17.777] [DEBUG] - StepSQLHandler execute: SELECT * FROM oceanbase.DBA_OB_SERVERS ORDER BY ZONE; [2025-12-08 16:09:17.781] [DEBUG] - step nu: 3 execute end [2025-12-08 16:09:17.781] [DEBUG] - step nu: 4 [2025-12-08 16:09:17.781] [DEBUG] - step nu: 4 initted, to execute [2025-12-08 16:09:17.781] [DEBUG] - step: {'type': 'sql', 'sql': "SELECT SVR_IP,SVR_PORT,ZONE,SQL_PORT,CPU_CAPACITY,CPU_CAPACITY_MAX,CPU_ASSIGNED,CPU_ASSIGNED_MAX, concat(ROUND(MEM_CAPACITY/1024/1024/1024,0), 'G') as MEM_CAPACITY, concat(ROUND(MEM_ASSIGNED/1024/1024/1024,0), 'G') as MEM_ASSIGNED, concat(ROUND(LOG_DISK_CAPACITY/1024/1024/1024,0), 'G') as LOG_DISK_CAPACITY, concat(ROUND(LOG_DISK_ASSIGNED/1024/1024/1024,0), 'G') as LOG_DISK_ASSIGNED, concat(ROUND(LOG_DISK_IN_USE/1024/1024/1024,0), 'G') as LOG_DISK_IN_USE, concat(ROUND(DATA_DISK_CAPACITY/1024/1024/1024,0), 'G') as DATA_DISK_CAPACITY,concat(ROUND(DATA_DISK_IN_USE/1024/1024/1024,0), 'G') as DATA_DISK_IN_USE,concat(ROUND(MEMORY_LIMIT/1024/1024/1024,0), 'G') as MEMORY_LIMIT FROM oceanbase.GV$OB_SERVERS;", 'global': True} [2025-12-08 16:09:17.784] [DEBUG] - connect databse ... [2025-12-08 16:09:17.786] [DEBUG] - StepSQLHandler execute: SELECT SVR_IP,SVR_PORT,ZONE,SQL_PORT,CPU_CAPACITY,CPU_CAPACITY_MAX,CPU_ASSIGNED,CPU_ASSIGNED_MAX, concat(ROUND(MEM_CAPACITY/1024/1024/1024,0), 'G') as MEM_CAPACITY, concat(ROUND(MEM_ASSIGNED/1024/1024/1024,0), 'G') as MEM_ASSIGNED, concat(ROUND(LOG_DISK_CAPACITY/1024/1024/1024,0), 'G') as LOG_DISK_CAPACITY, concat(ROUND(LOG_DISK_ASSIGNED/1024/1024/1024,0), 'G') as LOG_DISK_ASSIGNED, concat(ROUND(LOG_DISK_IN_USE/1024/1024/1024,0), 'G') as LOG_DISK_IN_USE, concat(ROUND(DATA_DISK_CAPACITY/1024/1024/1024,0), 'G') as DATA_DISK_CAPACITY,concat(ROUND(DATA_DISK_IN_USE/1024/1024/1024,0), 'G') as DATA_DISK_IN_USE,concat(ROUND(MEMORY_LIMIT/1024/1024/1024,0), 'G') as MEMORY_LIMIT FROM oceanbase.GV$OB_SERVERS; [2025-12-08 16:09:17.795] [DEBUG] - step nu: 4 execute end [2025-12-08 16:09:17.795] [DEBUG] - step nu: 5 [2025-12-08 16:09:17.795] [DEBUG] - step nu: 5 initted, to execute [2025-12-08 16:09:17.796] [DEBUG] - step: {'type': 'sql', 'sql': 'SELECT * FROM oceanbase.DBA_OB_TENANTS;', 'global': True} [2025-12-08 16:09:17.798] [DEBUG] - connect databse ... [2025-12-08 16:09:17.800] [DEBUG] - StepSQLHandler execute: SELECT * FROM oceanbase.DBA_OB_TENANTS; [2025-12-08 16:09:17.843] [DEBUG] - step nu: 5 execute end [2025-12-08 16:09:17.843] [DEBUG] - step nu: 6 [2025-12-08 16:09:17.843] [DEBUG] - step nu: 6 initted, to execute [2025-12-08 16:09:17.843] [DEBUG] - step: {'type': 'sql', 'sql': "SELECT c.TENANT_ID, e.TENANT_NAME, concat(c.NAME, ': ', d.NAME) `pool:conf`,concat(c.UNIT_COUNT, ' unit: ', d.min_cpu, 'C/', ROUND(d.MEMORY_SIZE/1024/1024/1024,0), 'G') unit_info FROM oceanbase.DBA_OB_RESOURCE_POOLS c, oceanbase.DBA_OB_UNIT_CONFIGS d, oceanbase.DBA_OB_TENANTS e WHERE c.UNIT_CONFIG_ID=d.UNIT_CONFIG_ID AND c.TENANT_ID=e.TENANT_ID ORDER BY c.TENANT_ID;", 'global': True} [2025-12-08 16:09:17.846] [DEBUG] - connect databse ... [2025-12-08 16:09:17.847] [DEBUG] - StepSQLHandler execute: SELECT c.TENANT_ID, e.TENANT_NAME, concat(c.NAME, ': ', d.NAME) `pool:conf`,concat(c.UNIT_COUNT, ' unit: ', d.min_cpu, 'C/', ROUND(d.MEMORY_SIZE/1024/1024/1024,0), 'G') unit_info FROM oceanbase.DBA_OB_RESOURCE_POOLS c, oceanbase.DBA_OB_UNIT_CONFIGS d, oceanbase.DBA_OB_TENANTS e WHERE c.UNIT_CONFIG_ID=d.UNIT_CONFIG_ID AND c.TENANT_ID=e.TENANT_ID ORDER BY c.TENANT_ID; [2025-12-08 16:09:17.853] [DEBUG] - step nu: 6 execute end [2025-12-08 16:09:17.853] [DEBUG] - step nu: 7 [2025-12-08 16:09:17.853] [DEBUG] - step nu: 7 initted, to execute [2025-12-08 16:09:17.853] [DEBUG] - step: {'type': 'sql', 'sql': 'SELECT a.TENANT_NAME,a.TENANT_ID,b.SVR_IP FROM oceanbase.DBA_OB_TENANTS a, oceanbase.GV$OB_UNITS b WHERE a.TENANT_ID=b.TENANT_ID;', 'global': True} [2025-12-08 16:09:17.855] [DEBUG] - connect databse ... [2025-12-08 16:09:17.856] [DEBUG] - StepSQLHandler execute: SELECT a.TENANT_NAME,a.TENANT_ID,b.SVR_IP FROM oceanbase.DBA_OB_TENANTS a, oceanbase.GV$OB_UNITS b WHERE a.TENANT_ID=b.TENANT_ID; [2025-12-08 16:09:17.866] [DEBUG] - step nu: 7 execute end [2025-12-08 16:09:17.866] [DEBUG] - step nu: 8 [2025-12-08 16:09:17.867] [DEBUG] - step nu: 8 initted, to execute [2025-12-08 16:09:17.867] [DEBUG] - step: {'type': 'sql', 'sql': 'select /*+read_consistency(weak) QUERY_TIMEOUT(60000000) */ t1.svr_ip, t1.role, t1.tenant_id,t1.database_name,t1.table_name, ifnull(t2.data_size,0) / 1073741824 as total_data_size_gb from (select tenant_id, database_name, table_name, role, svr_ip, table_id, tablet_id from oceanbase.cdb_ob_table_locations) t1 left join (select tenant_id, tablet_id, data_size from oceanbase.cdb_ob_tablet_replicas) t2 on t1.tenant_id = t2.tenant_id and t1.tablet_id = t2.tablet_id order by total_data_size_gb desc limit 50;', 'global': True} [2025-12-08 16:09:17.869] [DEBUG] - connect databse ... [2025-12-08 16:09:17.870] [DEBUG] - StepSQLHandler execute: select /*+read_consistency(weak) QUERY_TIMEOUT(60000000) */ t1.svr_ip, t1.role, t1.tenant_id,t1.database_name,t1.table_name, ifnull(t2.data_size,0) / 1073741824 as total_data_size_gb from (select tenant_id, database_name, table_name, role, svr_ip, table_id, tablet_id from oceanbase.cdb_ob_table_locations) t1 left join (select tenant_id, tablet_id, data_size from oceanbase.cdb_ob_tablet_replicas) t2 on t1.tenant_id = t2.tenant_id and t1.tablet_id = t2.tablet_id order by total_data_size_gb desc limit 50; [2025-12-08 16:09:18.335] [DEBUG] - step nu: 8 execute end [2025-12-08 16:09:18.335] [DEBUG] - step nu: 9 [2025-12-08 16:09:18.336] [DEBUG] - step nu: 9 initted, to execute [2025-12-08 16:09:18.336] [DEBUG] - step: {'type': 'sql', 'sql': 'show parameters', 'global': True} [2025-12-08 16:09:18.338] [DEBUG] - connect databse ... [2025-12-08 16:09:18.339] [DEBUG] - StepSQLHandler execute: show parameters [2025-12-08 16:09:19.215] [DEBUG] - step nu: 9 execute end [2025-12-08 16:09:19.215] [DEBUG] - step nu: 10 [2025-12-08 16:09:19.215] [DEBUG] - step nu: 10 initted, to execute [2025-12-08 16:09:19.215] [DEBUG] - step: {'type': 'sql', 'sql': 'select * from oceanbase.__all_virtual_sys_variable', 'global': True} [2025-12-08 16:09:19.219] [DEBUG] - connect databse ... [2025-12-08 16:09:19.220] [DEBUG] - StepSQLHandler execute: select * from oceanbase.__all_virtual_sys_variable [2025-12-08 16:09:20.812] [DEBUG] - step nu: 10 execute end [2025-12-08 16:09:20.813] [INFO] run scene excute yaml mode in node: 192.168.0.138 end [2025-12-08 16:09:20.813] [INFO] run scene excute yaml mode in node: 192.168.0.26 start [2025-12-08 16:09:20.813] [DEBUG] - step nu: 1 [2025-12-08 16:09:20.813] [DEBUG] - step nu: 1 initted, to execute [2025-12-08 16:09:20.813] [DEBUG] - step: {'type': 'sql', 'sql': "show variables like 'version_comment';", 'global': True} [2025-12-08 16:09:20.813] [DEBUG] - step sets the value of the global is true and it is processing the 2 node, skipping gather [2025-12-08 16:09:20.813] [DEBUG] - step nu: 1 execute end [2025-12-08 16:09:20.813] [DEBUG] - step nu: 2 [2025-12-08 16:09:20.814] [DEBUG] - step nu: 2 initted, to execute [2025-12-08 16:09:20.814] [DEBUG] - step: {'type': 'sql', 'sql': 'SELECT * FROM oceanbase.DBA_OB_ZONES ORDER BY ZONE;', 'global': True} [2025-12-08 16:09:20.814] [DEBUG] - step sets the value of the global is true and it is processing the 2 node, skipping gather [2025-12-08 16:09:20.814] [DEBUG] - step nu: 2 execute end [2025-12-08 16:09:20.814] [DEBUG] - step nu: 3 [2025-12-08 16:09:20.814] [DEBUG] - step nu: 3 initted, to execute [2025-12-08 16:09:20.814] [DEBUG] - step: {'type': 'sql', 'sql': 'SELECT * FROM oceanbase.DBA_OB_SERVERS ORDER BY ZONE;', 'global': True} [2025-12-08 16:09:20.814] [DEBUG] - step sets the value of the global is true and it is processing the 2 node, skipping gather [2025-12-08 16:09:20.814] [DEBUG] - step nu: 3 execute end [2025-12-08 16:09:20.814] [DEBUG] - step nu: 4 [2025-12-08 16:09:20.815] [DEBUG] - step nu: 4 initted, to execute [2025-12-08 16:09:20.815] [DEBUG] - step: {'type': 'sql', 'sql': "SELECT SVR_IP,SVR_PORT,ZONE,SQL_PORT,CPU_CAPACITY,CPU_CAPACITY_MAX,CPU_ASSIGNED,CPU_ASSIGNED_MAX, concat(ROUND(MEM_CAPACITY/1024/1024/1024,0), 'G') as MEM_CAPACITY, concat(ROUND(MEM_ASSIGNED/1024/1024/1024,0), 'G') as MEM_ASSIGNED, concat(ROUND(LOG_DISK_CAPACITY/1024/1024/1024,0), 'G') as LOG_DISK_CAPACITY, concat(ROUND(LOG_DISK_ASSIGNED/1024/1024/1024,0), 'G') as LOG_DISK_ASSIGNED, concat(ROUND(LOG_DISK_IN_USE/1024/1024/1024,0), 'G') as LOG_DISK_IN_USE, concat(ROUND(DATA_DISK_CAPACITY/1024/1024/1024,0), 'G') as DATA_DISK_CAPACITY,concat(ROUND(DATA_DISK_IN_USE/1024/1024/1024,0), 'G') as DATA_DISK_IN_USE,concat(ROUND(MEMORY_LIMIT/1024/1024/1024,0), 'G') as MEMORY_LIMIT FROM oceanbase.GV$OB_SERVERS;", 'global': True} [2025-12-08 16:09:20.815] [DEBUG] - step sets the value of the global is true and it is processing the 2 node, skipping gather [2025-12-08 16:09:20.815] [DEBUG] - step nu: 4 execute end [2025-12-08 16:09:20.815] [DEBUG] - step nu: 5 [2025-12-08 16:09:20.815] [DEBUG] - step nu: 5 initted, to execute [2025-12-08 16:09:20.815] [DEBUG] - step: {'type': 'sql', 'sql': 'SELECT * FROM oceanbase.DBA_OB_TENANTS;', 'global': True} [2025-12-08 16:09:20.815] [DEBUG] - step sets the value of the global is true and it is processing the 2 node, skipping gather [2025-12-08 16:09:20.815] [DEBUG] - step nu: 5 execute end [2025-12-08 16:09:20.815] [DEBUG] - step nu: 6 [2025-12-08 16:09:20.816] [DEBUG] - step nu: 6 initted, to execute [2025-12-08 16:09:20.816] [DEBUG] - step: {'type': 'sql', 'sql': "SELECT c.TENANT_ID, e.TENANT_NAME, concat(c.NAME, ': ', d.NAME) `pool:conf`,concat(c.UNIT_COUNT, ' unit: ', d.min_cpu, 'C/', ROUND(d.MEMORY_SIZE/1024/1024/1024,0), 'G') unit_info FROM oceanbase.DBA_OB_RESOURCE_POOLS c, oceanbase.DBA_OB_UNIT_CONFIGS d, oceanbase.DBA_OB_TENANTS e WHERE c.UNIT_CONFIG_ID=d.UNIT_CONFIG_ID AND c.TENANT_ID=e.TENANT_ID ORDER BY c.TENANT_ID;", 'global': True} [2025-12-08 16:09:20.816] [DEBUG] - step sets the value of the global is true and it is processing the 2 node, skipping gather [2025-12-08 16:09:20.816] [DEBUG] - step nu: 6 execute end [2025-12-08 16:09:20.816] [DEBUG] - step nu: 7 [2025-12-08 16:09:20.816] [DEBUG] - step nu: 7 initted, to execute [2025-12-08 16:09:20.816] [DEBUG] - step: {'type': 'sql', 'sql': 'SELECT a.TENANT_NAME,a.TENANT_ID,b.SVR_IP FROM oceanbase.DBA_OB_TENANTS a, oceanbase.GV$OB_UNITS b WHERE a.TENANT_ID=b.TENANT_ID;', 'global': True} [2025-12-08 16:09:20.816] [DEBUG] - step sets the value of the global is true and it is processing the 2 node, skipping gather [2025-12-08 16:09:20.816] [DEBUG] - step nu: 7 execute end [2025-12-08 16:09:20.816] [DEBUG] - step nu: 8 [2025-12-08 16:09:20.816] [DEBUG] - step nu: 8 initted, to execute [2025-12-08 16:09:20.817] [DEBUG] - step: {'type': 'sql', 'sql': 'select /*+read_consistency(weak) QUERY_TIMEOUT(60000000) */ t1.svr_ip, t1.role, t1.tenant_id,t1.database_name,t1.table_name, ifnull(t2.data_size,0) / 1073741824 as total_data_size_gb from (select tenant_id, database_name, table_name, role, svr_ip, table_id, tablet_id from oceanbase.cdb_ob_table_locations) t1 left join (select tenant_id, tablet_id, data_size from oceanbase.cdb_ob_tablet_replicas) t2 on t1.tenant_id = t2.tenant_id and t1.tablet_id = t2.tablet_id order by total_data_size_gb desc limit 50;', 'global': True} [2025-12-08 16:09:20.817] [DEBUG] - step sets the value of the global is true and it is processing the 2 node, skipping gather [2025-12-08 16:09:20.817] [DEBUG] - step nu: 8 execute end [2025-12-08 16:09:20.817] [DEBUG] - step nu: 9 [2025-12-08 16:09:20.817] [DEBUG] - step nu: 9 initted, to execute [2025-12-08 16:09:20.817] [DEBUG] - step: {'type': 'sql', 'sql': 'show parameters', 'global': True} [2025-12-08 16:09:20.817] [DEBUG] - step sets the value of the global is true and it is processing the 2 node, skipping gather [2025-12-08 16:09:20.817] [DEBUG] - step nu: 9 execute end [2025-12-08 16:09:20.817] [DEBUG] - step nu: 10 [2025-12-08 16:09:20.817] [DEBUG] - step nu: 10 initted, to execute [2025-12-08 16:09:20.818] [DEBUG] - step: {'type': 'sql', 'sql': 'select * from oceanbase.__all_virtual_sys_variable', 'global': True} [2025-12-08 16:09:20.818] [DEBUG] - step sets the value of the global is true and it is processing the 2 node, skipping gather [2025-12-08 16:09:20.818] [DEBUG] - step nu: 10 execute end [2025-12-08 16:09:20.818] [INFO] run scene excute yaml mode in node: 192.168.0.26 end [2025-12-08 16:09:20.818] [INFO] run scene excute yaml mode in node: 192.168.0.33 start [2025-12-08 16:09:20.818] [DEBUG] - step nu: 1 [2025-12-08 16:09:20.818] [DEBUG] - step nu: 1 initted, to execute [2025-12-08 16:09:20.818] [DEBUG] - step: {'type': 'sql', 'sql': "show variables like 'version_comment';", 'global': True} [2025-12-08 16:09:20.818] [DEBUG] - step sets the value of the global is true and it is processing the 3 node, skipping gather [2025-12-08 16:09:20.818] [DEBUG] - step nu: 1 execute end [2025-12-08 16:09:20.819] [DEBUG] - step nu: 2 [2025-12-08 16:09:20.819] [DEBUG] - step nu: 2 initted, to execute [2025-12-08 16:09:20.819] [DEBUG] - step: {'type': 'sql', 'sql': 'SELECT * FROM oceanbase.DBA_OB_ZONES ORDER BY ZONE;', 'global': True} [2025-12-08 16:09:20.819] [DEBUG] - step sets the value of the global is true and it is processing the 3 node, skipping gather [2025-12-08 16:09:20.819] [DEBUG] - step nu: 2 execute end [2025-12-08 16:09:20.819] [DEBUG] - step nu: 3 [2025-12-08 16:09:20.819] [DEBUG] - step nu: 3 initted, to execute [2025-12-08 16:09:20.819] [DEBUG] - step: {'type': 'sql', 'sql': 'SELECT * FROM oceanbase.DBA_OB_SERVERS ORDER BY ZONE;', 'global': True} [2025-12-08 16:09:20.819] [DEBUG] - step sets the value of the global is true and it is processing the 3 node, skipping gather [2025-12-08 16:09:20.819] [DEBUG] - step nu: 3 execute end [2025-12-08 16:09:20.819] [DEBUG] - step nu: 4 [2025-12-08 16:09:20.820] [DEBUG] - step nu: 4 initted, to execute [2025-12-08 16:09:20.820] [DEBUG] - step: {'type': 'sql', 'sql': "SELECT SVR_IP,SVR_PORT,ZONE,SQL_PORT,CPU_CAPACITY,CPU_CAPACITY_MAX,CPU_ASSIGNED,CPU_ASSIGNED_MAX, concat(ROUND(MEM_CAPACITY/1024/1024/1024,0), 'G') as MEM_CAPACITY, concat(ROUND(MEM_ASSIGNED/1024/1024/1024,0), 'G') as MEM_ASSIGNED, concat(ROUND(LOG_DISK_CAPACITY/1024/1024/1024,0), 'G') as LOG_DISK_CAPACITY, concat(ROUND(LOG_DISK_ASSIGNED/1024/1024/1024,0), 'G') as LOG_DISK_ASSIGNED, concat(ROUND(LOG_DISK_IN_USE/1024/1024/1024,0), 'G') as LOG_DISK_IN_USE, concat(ROUND(DATA_DISK_CAPACITY/1024/1024/1024,0), 'G') as DATA_DISK_CAPACITY,concat(ROUND(DATA_DISK_IN_USE/1024/1024/1024,0), 'G') as DATA_DISK_IN_USE,concat(ROUND(MEMORY_LIMIT/1024/1024/1024,0), 'G') as MEMORY_LIMIT FROM oceanbase.GV$OB_SERVERS;", 'global': True} [2025-12-08 16:09:20.820] [DEBUG] - step sets the value of the global is true and it is processing the 3 node, skipping gather [2025-12-08 16:09:20.820] [DEBUG] - step nu: 4 execute end [2025-12-08 16:09:20.820] [DEBUG] - step nu: 5 [2025-12-08 16:09:20.820] [DEBUG] - step nu: 5 initted, to execute [2025-12-08 16:09:20.820] [DEBUG] - step: {'type': 'sql', 'sql': 'SELECT * FROM oceanbase.DBA_OB_TENANTS;', 'global': True} [2025-12-08 16:09:20.820] [DEBUG] - step sets the value of the global is true and it is processing the 3 node, skipping gather [2025-12-08 16:09:20.820] [DEBUG] - step nu: 5 execute end [2025-12-08 16:09:20.820] [DEBUG] - step nu: 6 [2025-12-08 16:09:20.821] [DEBUG] - step nu: 6 initted, to execute [2025-12-08 16:09:20.821] [DEBUG] - step: {'type': 'sql', 'sql': "SELECT c.TENANT_ID, e.TENANT_NAME, concat(c.NAME, ': ', d.NAME) `pool:conf`,concat(c.UNIT_COUNT, ' unit: ', d.min_cpu, 'C/', ROUND(d.MEMORY_SIZE/1024/1024/1024,0), 'G') unit_info FROM oceanbase.DBA_OB_RESOURCE_POOLS c, oceanbase.DBA_OB_UNIT_CONFIGS d, oceanbase.DBA_OB_TENANTS e WHERE c.UNIT_CONFIG_ID=d.UNIT_CONFIG_ID AND c.TENANT_ID=e.TENANT_ID ORDER BY c.TENANT_ID;", 'global': True} [2025-12-08 16:09:20.821] [DEBUG] - step sets the value of the global is true and it is processing the 3 node, skipping gather [2025-12-08 16:09:20.821] [DEBUG] - step nu: 6 execute end [2025-12-08 16:09:20.821] [DEBUG] - step nu: 7 [2025-12-08 16:09:20.821] [DEBUG] - step nu: 7 initted, to execute [2025-12-08 16:09:20.821] [DEBUG] - step: {'type': 'sql', 'sql': 'SELECT a.TENANT_NAME,a.TENANT_ID,b.SVR_IP FROM oceanbase.DBA_OB_TENANTS a, oceanbase.GV$OB_UNITS b WHERE a.TENANT_ID=b.TENANT_ID;', 'global': True} [2025-12-08 16:09:20.821] [DEBUG] - step sets the value of the global is true and it is processing the 3 node, skipping gather [2025-12-08 16:09:20.821] [DEBUG] - step nu: 7 execute end [2025-12-08 16:09:20.821] [DEBUG] - step nu: 8 [2025-12-08 16:09:20.821] [DEBUG] - step nu: 8 initted, to execute [2025-12-08 16:09:20.822] [DEBUG] - step: {'type': 'sql', 'sql': 'select /*+read_consistency(weak) QUERY_TIMEOUT(60000000) */ t1.svr_ip, t1.role, t1.tenant_id,t1.database_name,t1.table_name, ifnull(t2.data_size,0) / 1073741824 as total_data_size_gb from (select tenant_id, database_name, table_name, role, svr_ip, table_id, tablet_id from oceanbase.cdb_ob_table_locations) t1 left join (select tenant_id, tablet_id, data_size from oceanbase.cdb_ob_tablet_replicas) t2 on t1.tenant_id = t2.tenant_id and t1.tablet_id = t2.tablet_id order by total_data_size_gb desc limit 50;', 'global': True} [2025-12-08 16:09:20.822] [DEBUG] - step sets the value of the global is true and it is processing the 3 node, skipping gather [2025-12-08 16:09:20.822] [DEBUG] - step nu: 8 execute end [2025-12-08 16:09:20.822] [DEBUG] - step nu: 9 [2025-12-08 16:09:20.822] [DEBUG] - step nu: 9 initted, to execute [2025-12-08 16:09:20.822] [DEBUG] - step: {'type': 'sql', 'sql': 'show parameters', 'global': True} [2025-12-08 16:09:20.822] [DEBUG] - step sets the value of the global is true and it is processing the 3 node, skipping gather [2025-12-08 16:09:20.822] [DEBUG] - step nu: 9 execute end [2025-12-08 16:09:20.822] [DEBUG] - step nu: 10 [2025-12-08 16:09:20.822] [DEBUG] - step nu: 10 initted, to execute [2025-12-08 16:09:20.822] [DEBUG] - step: {'type': 'sql', 'sql': 'select * from oceanbase.__all_virtual_sys_variable', 'global': True} [2025-12-08 16:09:20.822] [DEBUG] - step sets the value of the global is true and it is processing the 3 node, skipping gather [2025-12-08 16:09:20.822] [DEBUG] - step nu: 10 execute end [2025-12-08 16:09:20.823] [INFO] run scene excute yaml mode in node: 192.168.0.33 end [2025-12-08 16:09:20.823] [DEBUG] - run scene excute yaml mode in node [2025-12-08 16:09:20.823] [DEBUG] - execute tasks end : observer.base [2025-12-08 16:09:20.823] [DEBUG] - execute tasks is observer.perf_sql [2025-12-08 16:09:20.823] [DEBUG] - observer.perf_sql execute! [2025-12-08 16:09:20.923] [DEBUG] - Execute Shell command on server 192.168.0.26:ps aux | grep observer | grep 'P 2882' | grep -oP '/[^\s]*/bin/observer' [2025-12-08 16:09:21.074] [DEBUG] - home_path:/data1/myoceanbase/oceanbase [2025-12-08 16:09:21.074] [DEBUG] - gather observer log start [2025-12-08 16:09:21.075] [DEBUG] - store_dir rebase: /root/obdiag_gather_pack_20251208160917 [2025-12-08 16:09:21.075] [INFO] No time option provided, default processing is based on the last 30 minutes [2025-12-08 16:09:21.075] [INFO] gather log from_time: 2025-12-08 15:39:21, to_time: 2025-12-08 16:10:21 [2025-12-08 16:09:21.075] [DEBUG] - file_number_limit: 50, file_size_limit: 5368709120, gather log config_path: ~/.obdiag/config.yml [2025-12-08 16:09:21.075] [DEBUG] - thread_nums: 3 [2025-12-08 16:09:21.076] [INFO] gather start [2025-12-08 16:09:21.079] [DEBUG] -- log_path: /data1/myoceanbase/oceanbase/log [2025-12-08 16:09:21.080] [DEBUG] - file_queue len: 1 [2025-12-08 16:09:21.221] [DEBUG] -- Execute Shell command on server 192.168.0.26:mkdir -p /tmp/obdiag_gather_087fe8 [2025-12-08 16:09:21.333] [DEBUG] -- Execute Shell command on server 192.168.0.26:mkdir -p /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12 [2025-12-08 16:09:21.402] [DEBUG] -- gather_log_on_node 192.168.0.26 tmp_log_dir: /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12, info: [2025-12-08 16:09:21.402] [DEBUG] -- gather_log_on_node 192.168.0.26 find logs scope: -name "*observer*" -o -name "*rootservice*" -o -name "*election*" [2025-12-08 16:09:21.402] [DEBUG] -- gather_log_on_node 192.168.0.26 find logs cmd: find /data1/myoceanbase/oceanbase/log/ -name "*observer*" -o -name "*rootservice*" -o -name "*election*" | awk -F '/' '{print $NF}' | sort [2025-12-08 16:09:21.403] [DEBUG] -- Execute Shell command on server 192.168.0.26:find /data1/myoceanbase/oceanbase/log/ -name "*observer*" -o -name "*rootservice*" -o -name "*election*" | awk -F '/' '{print $NF}' | sort [2025-12-08 16:09:21.477] [DEBUG] -- get log file name list, from time 2025-12-08 15:39:21, to time 2025-12-08 16:10:21, log dir /data1/myoceanbase/oceanbase/log, log files election.log [2025-12-08 16:09:21.477] [DEBUG] election.log.wf [2025-12-08 16:09:21.477] [DEBUG] observer.log [2025-12-08 16:09:21.478] [DEBUG] observer.log.20251208145505098 [2025-12-08 16:09:21.478] [DEBUG] observer.log.20251208150305114 [2025-12-08 16:09:21.478] [DEBUG] observer.log.20251208151036679 [2025-12-08 16:09:21.478] [DEBUG] observer.log.20251208151744759 [2025-12-08 16:09:21.478] [DEBUG] observer.log.20251208152315288 [2025-12-08 16:09:21.478] [DEBUG] observer.log.20251208152950836 [2025-12-08 16:09:21.478] [DEBUG] observer.log.20251208153648529 [2025-12-08 16:09:21.478] [DEBUG] observer.log.20251208154242770 [2025-12-08 16:09:21.478] [DEBUG] observer.log.20251208154821784 [2025-12-08 16:09:21.478] [DEBUG] observer.log.20251208155421468 [2025-12-08 16:09:21.478] [DEBUG] observer.log.20251208160053710 [2025-12-08 16:09:21.478] [DEBUG] observer.log.20251208160800707 [2025-12-08 16:09:21.478] [DEBUG] observer.log.wf [2025-12-08 16:09:21.478] [DEBUG] rootservice.log [2025-12-08 16:09:21.478] [DEBUG] rootservice.log.wf [2025-12-08 16:09:21.479] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/election.log | head -n 1 [2025-12-08 16:09:21.550] [DEBUG] -- node: remote_192_168_0_26, The log file election.log first line text: [2025-12-08 04:53:19.573513] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:21.551] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/election.log | tail -n 1 [2025-12-08 16:09:21.909] [DEBUG] -- node: remote_192_168_0_26, The log file election.log last line text: [2025-12-08 16:09:21.895581] INFO [ELECT] operator() (election_proposer.cpp:232) [51657][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=103] dump proposer info(*this={ls_id:{id:1}, addr:"192.168.0.26:2882", role:Follower, ballot_number:0, lease_interval:-0.00s, memberlist_with_states:{member_list:{addr_list:["192.168.0.26:2882", "192.168.0.33:2882", "192.168.0.138:2882"], membership_version:{proposal_id:1, config_seq:2}, replica_num:3}, prepare_ok:False, accept_ok_promised_ts:invalid, follower_promise_membership_version:{proposal_id:9223372036854775807, config_seq:-1}}, priority_seed:0x1000, restart_counter:1, last_do_prepare_ts:2025-12-01 15:32:10.392107, self_priority:{priority:{is_valid:true, is_observer_stopped:false, is_server_stopped:false, is_zone_stopped:false, fatal_failures:[], is_primary_region:true, serious_failures:[], is_in_blacklist:false, in_blacklist_reason:, scn:{val:1765181361327217000, v:0}, is_manual_leader:false, zone_priority:1}}, p_election:0x7fd606d97a30}) [2025-12-08 16:09:21.909] [DEBUG] -- node: remote_192_168_0_26, The log file election.log start time: 2025-12-08 04:53:19, end time: 2025-12-08 16:09:21 [2025-12-08 16:09:21.910] [DEBUG] -- node: remote_192_168_0_26, The log file election.log start 2025-12-08 04:53:19, end 2025-12-08 16:09:21 is range 2025-12-08 15:39:21 to 2025-12-08 16:10:21 [2025-12-08 16:09:21.910] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/election.log.wf | head -n 1 [2025-12-08 16:09:21.982] [DEBUG] -- node: remote_192_168_0_26, The log file election.log.wf first line text: [2025-12-02 09:00:34.367674] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:21.984] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/election.log.wf | tail -n 1 [2025-12-08 16:09:22.052] [DEBUG] -- node: remote_192_168_0_26, The log file election.log.wf last line text: [2025-12-08 04:53:19.573513] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:22.052] [DEBUG] -- node: remote_192_168_0_26, The log file election.log.wf start time: 2025-12-02 09:00:34, end time: 2025-12-08 04:53:19 [2025-12-08 16:09:22.053] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log | head -n 1 [2025-12-08 16:09:22.122] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log first line text: [2025-12-08 16:08:00.717652] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:22.123] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log | tail -n 1 [2025-12-08 16:09:22.285] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log last line text: [2025-12-08 16:09:22.280424] WDIAG [SQL] move_to_sqlstat_cache (ob_sql_stat_record.cpp:328) [1621007][T1002_L0_G0][T1002][YB42C0A8001A-000644EA3E98E934-0-0] [lt=21][errcode=0] the key is not valid which at plan cache mgr(ret=0, ret="OB_SUCCESS") [2025-12-08 16:09:22.286] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log start time: 2025-12-08 16:08:00, end time: 2025-12-08 16:09:22 [2025-12-08 16:09:22.286] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log start 2025-12-08 16:08:00, end 2025-12-08 16:09:22 is range 2025-12-08 15:39:21 to 2025-12-08 16:10:21 [2025-12-08 16:09:22.286] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.20251208145505098 | head -n 1 [2025-12-08 16:09:22.358] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208145505098 first line text: [2025-12-08 14:47:18.513048] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:22.358] [DEBUG] -- node: remote_192_168_0_26, file_name: observer.log.20251208145505098, file_start_time_str: 2025-12-08 14:47:18, file_end_time_str: 2025-12-08 14:55:05 [2025-12-08 16:09:22.358] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208145505098 end time: 2025-12-08 14:55:05 [2025-12-08 16:09:22.359] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.20251208150305114 | head -n 1 [2025-12-08 16:09:22.427] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208150305114 first line text: [2025-12-08 14:55:05.106695] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:22.427] [DEBUG] -- node: remote_192_168_0_26, file_name: observer.log.20251208150305114, file_start_time_str: 2025-12-08 14:55:05, file_end_time_str: 2025-12-08 15:03:05 [2025-12-08 16:09:22.427] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208150305114 end time: 2025-12-08 15:03:05 [2025-12-08 16:09:22.428] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.20251208151036679 | head -n 1 [2025-12-08 16:09:22.495] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208151036679 first line text: [2025-12-08 15:03:05.126077] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:22.495] [DEBUG] -- node: remote_192_168_0_26, file_name: observer.log.20251208151036679, file_start_time_str: 2025-12-08 15:03:05, file_end_time_str: 2025-12-08 15:10:36 [2025-12-08 16:09:22.496] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208151036679 end time: 2025-12-08 15:10:36 [2025-12-08 16:09:22.496] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.20251208151744759 | head -n 1 [2025-12-08 16:09:22.566] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208151744759 first line text: [2025-12-08 15:10:36.687165] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:22.566] [DEBUG] -- node: remote_192_168_0_26, file_name: observer.log.20251208151744759, file_start_time_str: 2025-12-08 15:10:36, file_end_time_str: 2025-12-08 15:17:44 [2025-12-08 16:09:22.567] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208151744759 end time: 2025-12-08 15:17:44 [2025-12-08 16:09:22.567] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.20251208152315288 | head -n 1 [2025-12-08 16:09:22.636] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208152315288 first line text: [2025-12-08 15:17:44.767629] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:22.636] [DEBUG] -- node: remote_192_168_0_26, file_name: observer.log.20251208152315288, file_start_time_str: 2025-12-08 15:17:44, file_end_time_str: 2025-12-08 15:23:15 [2025-12-08 16:09:22.636] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208152315288 end time: 2025-12-08 15:23:15 [2025-12-08 16:09:22.637] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.20251208152950836 | head -n 1 [2025-12-08 16:09:22.705] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208152950836 first line text: [2025-12-08 15:23:15.302265] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:22.705] [DEBUG] -- node: remote_192_168_0_26, file_name: observer.log.20251208152950836, file_start_time_str: 2025-12-08 15:23:15, file_end_time_str: 2025-12-08 15:29:50 [2025-12-08 16:09:22.705] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208152950836 end time: 2025-12-08 15:29:50 [2025-12-08 16:09:22.706] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.20251208153648529 | head -n 1 [2025-12-08 16:09:22.771] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208153648529 first line text: [2025-12-08 15:29:50.845860] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:22.772] [DEBUG] -- node: remote_192_168_0_26, file_name: observer.log.20251208153648529, file_start_time_str: 2025-12-08 15:29:50, file_end_time_str: 2025-12-08 15:36:48 [2025-12-08 16:09:22.772] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208153648529 end time: 2025-12-08 15:36:48 [2025-12-08 16:09:22.773] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.20251208154242770 | head -n 1 [2025-12-08 16:09:22.848] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208154242770 first line text: [2025-12-08 15:36:48.536595] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:22.849] [DEBUG] -- node: remote_192_168_0_26, file_name: observer.log.20251208154242770, file_start_time_str: 2025-12-08 15:36:48, file_end_time_str: 2025-12-08 15:42:42 [2025-12-08 16:09:22.849] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208154242770 end time: 2025-12-08 15:42:42 [2025-12-08 16:09:22.849] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208154242770 start 2025-12-08 15:36:48, end 2025-12-08 15:42:42 is range 2025-12-08 15:39:21 to 2025-12-08 16:10:21 [2025-12-08 16:09:22.850] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.20251208154821784 | head -n 1 [2025-12-08 16:09:22.960] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208154821784 first line text: [2025-12-08 15:42:42.780399] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:22.960] [DEBUG] -- node: remote_192_168_0_26, file_name: observer.log.20251208154821784, file_start_time_str: 2025-12-08 15:42:42, file_end_time_str: 2025-12-08 15:48:21 [2025-12-08 16:09:22.960] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208154821784 end time: 2025-12-08 15:48:21 [2025-12-08 16:09:22.960] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208154821784 start 2025-12-08 15:42:42, end 2025-12-08 15:48:21 is range 2025-12-08 15:39:21 to 2025-12-08 16:10:21 [2025-12-08 16:09:22.961] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.20251208155421468 | head -n 1 [2025-12-08 16:09:23.034] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208155421468 first line text: [2025-12-08 15:48:21.793536] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:23.034] [DEBUG] -- node: remote_192_168_0_26, file_name: observer.log.20251208155421468, file_start_time_str: 2025-12-08 15:48:21, file_end_time_str: 2025-12-08 15:54:21 [2025-12-08 16:09:23.034] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208155421468 end time: 2025-12-08 15:54:21 [2025-12-08 16:09:23.035] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208155421468 start 2025-12-08 15:48:21, end 2025-12-08 15:54:21 is range 2025-12-08 15:39:21 to 2025-12-08 16:10:21 [2025-12-08 16:09:23.040] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.20251208160053710 | head -n 1 [2025-12-08 16:09:23.104] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208160053710 first line text: [2025-12-08 15:54:21.478293] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:23.104] [DEBUG] -- node: remote_192_168_0_26, file_name: observer.log.20251208160053710, file_start_time_str: 2025-12-08 15:54:21, file_end_time_str: 2025-12-08 16:00:53 [2025-12-08 16:09:23.104] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208160053710 end time: 2025-12-08 16:00:53 [2025-12-08 16:09:23.105] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208160053710 start 2025-12-08 15:54:21, end 2025-12-08 16:00:53 is range 2025-12-08 15:39:21 to 2025-12-08 16:10:21 [2025-12-08 16:09:23.105] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.20251208160800707 | head -n 1 [2025-12-08 16:09:23.172] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208160800707 first line text: [2025-12-08 16:00:53.717353] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:23.172] [DEBUG] -- node: remote_192_168_0_26, file_name: observer.log.20251208160800707, file_start_time_str: 2025-12-08 16:00:53, file_end_time_str: 2025-12-08 16:08:00 [2025-12-08 16:09:23.172] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208160800707 end time: 2025-12-08 16:08:00 [2025-12-08 16:09:23.172] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.20251208160800707 start 2025-12-08 16:00:53, end 2025-12-08 16:08:00 is range 2025-12-08 15:39:21 to 2025-12-08 16:10:21 [2025-12-08 16:09:23.173] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.wf | head -n 1 [2025-12-08 16:09:23.241] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.wf first line text: [2025-12-01 15:34:44.675296] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:23.242] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/observer.log.wf | tail -n 1 [2025-12-08 16:09:23.319] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.wf last line text: [2025-12-08 16:08:00.717652] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:23.320] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.wf start time: 2025-12-01 15:34:44, end time: 2025-12-08 16:08:00 [2025-12-08 16:09:23.320] [DEBUG] -- node: remote_192_168_0_26, The log file observer.log.wf start 2025-12-01 15:34:44, end 2025-12-08 16:08:00 is range 2025-12-08 15:39:21 to 2025-12-08 16:10:21 [2025-12-08 16:09:23.320] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/rootservice.log | head -n 1 [2025-12-08 16:09:23.396] [DEBUG] -- node: remote_192_168_0_26, The log file rootservice.log first line text: [2025-12-08 09:24:36.720734] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:23.397] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/rootservice.log | tail -n 1 [2025-12-08 16:09:23.917] [DEBUG] -- node: remote_192_168_0_26, The log file rootservice.log last line text: [2025-12-08 16:09:23.830490] INFO [RS] do_work (ob_standby_schema_refresh_trigger.cpp:68) [50153][T1_StandbySchem][T1][YB42C0A8001A-000644DEE1AE3AEC-0-0] [lt=27] [STANDBY_SCHEMA_REFRESH_TRIGGER] finish one round(ret=0, ret="OB_SUCCESS") [2025-12-08 16:09:23.918] [DEBUG] -- node: remote_192_168_0_26, The log file rootservice.log start time: 2025-12-08 09:24:36, end time: 2025-12-08 16:09:23 [2025-12-08 16:09:23.918] [DEBUG] -- node: remote_192_168_0_26, The log file rootservice.log start 2025-12-08 09:24:36, end 2025-12-08 16:09:23 is range 2025-12-08 15:39:21 to 2025-12-08 16:10:21 [2025-12-08 16:09:23.919] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/rootservice.log.wf | head -n 1 [2025-12-08 16:09:23.992] [DEBUG] -- node: remote_192_168_0_26, The log file rootservice.log.wf first line text: [2025-12-01 15:51:55.482643] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:23.993] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -aE "[0-9]{4}-[0-9]{2}-[0-9]{2} [0-9]{2}:[0-9]{2}:[0-9]{2}\.[0-9]{6}" /data1/myoceanbase/oceanbase/log/rootservice.log.wf | tail -n 1 [2025-12-08 16:09:24.093] [DEBUG] -- node: remote_192_168_0_26, The log file rootservice.log.wf last line text: [2025-12-08 09:24:36.720734] INFO New syslog file info: [address: "192.168.0.26:2882", observer version: OceanBase_CE 4.4.1.0, revision: 100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88, sysname: Linux, os release: 4.18.0-348.7.1.el8_5.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-12-08 16:09:24.093] [DEBUG] -- node: remote_192_168_0_26, The log file rootservice.log.wf start time: 2025-12-01 15:51:55, end time: 2025-12-08 09:24:36 [2025-12-08 16:09:24.093] [DEBUG] -- Find the qualified log file ['election.log', 'observer.log', 'observer.log.20251208154242770', 'observer.log.20251208154821784', 'observer.log.20251208155421468', 'observer.log.20251208160053710', 'observer.log.20251208160800707', 'observer.log.wf', 'rootservice.log'] on Server [192.168.0.26], wait for the next step [2025-12-08 16:09:24.093] [DEBUG] -- grep files, grep_option = ['YB42C0A8001A-000644EA3E986579-0-0'] [2025-12-08 16:09:24.094] [DEBUG] -- grep files, source_log_name = [/data1/myoceanbase/oceanbase/log/election.log], target_log_name = [/tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/election.log] [2025-12-08 16:09:24.094] [DEBUG] -- grep files, run cmd = [grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/election.log > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/election.log ] [2025-12-08 16:09:24.094] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/election.log > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/election.log [2025-12-08 16:09:24.249] [DEBUG] -- grep files, source_log_name = [/data1/myoceanbase/oceanbase/log/observer.log], target_log_name = [/tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log] [2025-12-08 16:09:24.250] [DEBUG] -- grep files, run cmd = [grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log ] [2025-12-08 16:09:24.251] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log [2025-12-08 16:09:24.367] [DEBUG] -- grep files, source_log_name = [/data1/myoceanbase/oceanbase/log/observer.log.20251208154242770], target_log_name = [/tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208154242770] [2025-12-08 16:09:24.367] [DEBUG] -- grep files, run cmd = [grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log.20251208154242770 > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208154242770 ] [2025-12-08 16:09:24.368] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log.20251208154242770 > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208154242770 [2025-12-08 16:09:24.637] [DEBUG] -- grep files, source_log_name = [/data1/myoceanbase/oceanbase/log/observer.log.20251208154821784], target_log_name = [/tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208154821784] [2025-12-08 16:09:24.638] [DEBUG] -- grep files, run cmd = [grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log.20251208154821784 > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208154821784 ] [2025-12-08 16:09:24.639] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log.20251208154821784 > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208154821784 [2025-12-08 16:09:24.864] [DEBUG] -- grep files, source_log_name = [/data1/myoceanbase/oceanbase/log/observer.log.20251208155421468], target_log_name = [/tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208155421468] [2025-12-08 16:09:24.864] [DEBUG] -- grep files, run cmd = [grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log.20251208155421468 > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208155421468 ] [2025-12-08 16:09:24.865] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log.20251208155421468 > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208155421468 [2025-12-08 16:09:25.065] [DEBUG] -- grep files, source_log_name = [/data1/myoceanbase/oceanbase/log/observer.log.20251208160053710], target_log_name = [/tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208160053710] [2025-12-08 16:09:25.065] [DEBUG] -- grep files, run cmd = [grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log.20251208160053710 > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208160053710 ] [2025-12-08 16:09:25.065] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log.20251208160053710 > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208160053710 [2025-12-08 16:09:25.294] [DEBUG] -- grep files, source_log_name = [/data1/myoceanbase/oceanbase/log/observer.log.20251208160800707], target_log_name = [/tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208160800707] [2025-12-08 16:09:25.294] [DEBUG] -- grep files, run cmd = [grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log.20251208160800707 > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208160800707 ] [2025-12-08 16:09:25.295] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log.20251208160800707 > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.20251208160800707 [2025-12-08 16:09:25.500] [DEBUG] -- grep files, source_log_name = [/data1/myoceanbase/oceanbase/log/observer.log.wf], target_log_name = [/tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.wf] [2025-12-08 16:09:25.501] [DEBUG] -- grep files, run cmd = [grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log.wf > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.wf ] [2025-12-08 16:09:25.501] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/observer.log.wf > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/observer.log.wf [2025-12-08 16:09:25.567] [DEBUG] -- grep files, source_log_name = [/data1/myoceanbase/oceanbase/log/rootservice.log], target_log_name = [/tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/rootservice.log] [2025-12-08 16:09:25.567] [DEBUG] -- grep files, run cmd = [grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/rootservice.log > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/rootservice.log ] [2025-12-08 16:09:25.568] [DEBUG] -- Execute Shell command on server 192.168.0.26:grep -e 'YB42C0A8001A-000644EA3E986579-0-0' /data1/myoceanbase/oceanbase/log/rootservice.log > /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/rootservice.log [2025-12-08 16:09:25.745] [DEBUG] -- Execute Shell command on server 192.168.0.26:ls -A /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12|wc -w [2025-12-08 16:09:25.816] [DEBUG] -- gather_log_on_node 192.168.0.26 tar_cmd: cd /tmp/obdiag_gather_087fe8 && tar -czf observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/* [2025-12-08 16:09:25.817] [DEBUG] -- Execute Shell command on server 192.168.0.26:cd /tmp/obdiag_gather_087fe8 && tar -czf observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12/* [2025-12-08 16:09:25.889] [DEBUG] -- gather_log_on_node 192.168.0.26 tar request: [2025-12-08 16:09:25.890] [DEBUG] -- Execute Shell command on server 192.168.0.26:ls -nl /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz | awk '{print $5}' [2025-12-08 16:09:25.957] [DEBUG] -- gather_log_on_node 192.168.0.26 tar_file_size: 13251 [2025-12-08 16:09:25.958] [DEBUG] -- gather_log_on_node 192.168.0.26 download log to local store_dir: /root/obdiag_gather_pack_20251208160917 [2025-12-08 16:09:25.958] [DEBUG] -- Execute Shell command on server 192.168.0.26:chomd -R a+rx /tmp/obdiag_gather_087fe8 [2025-12-08 16:09:26.023] [DEBUG] -- download file: /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz to /root/obdiag_gather_pack_20251208160917/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz [2025-12-08 16:09:26.023] [DEBUG] -- download file mkdir local dir /root/obdiag_gather_pack_20251208160917 [2025-12-08 16:09:26.106] [DEBUG] -- Download 192.168.0.26:/tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz [2025-12-08 16:09:26.110] [DEBUG] -- download success. gather_log_on_node 192.168.0.26 delete tar file: /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz [2025-12-08 16:09:26.111] [DEBUG] -- Execute Shell command on server 192.168.0.26:rm -rf /tmp/obdiag_gather_087fe8/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz [2025-12-08 16:09:26.176] [DEBUG] -- tar_file_name: observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz [2025-12-08 16:09:26.176] [DEBUG] -- local_tar_file_path: /root/obdiag_gather_pack_20251208160917/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz [2025-12-08 16:09:26.176] [DEBUG] -- clear tmp_log_dir: /tmp/obdiag_gather_087fe8 [2025-12-08 16:09:26.177] [DEBUG] -- Execute Shell command on server 192.168.0.26:rm -rf /tmp/obdiag_gather_087fe8 [2025-12-08 16:09:26.259] [DEBUG] -- gather_log_on_node 192.168.0.26 finished [2025-12-08 16:09:26.260] [DEBUG] -- gather_log_on_node 192.168.0.26 gather_tuple: {'node': 'remote_192_168_0_26', 'success': 'Success', 'info': 'file save in /root/obdiag_gather_pack_20251208160917/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz', 'file_size': '12.940K', 'file_path': '/root/obdiag_gather_pack_20251208160917/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz'} [2025-12-08 16:09:26.260] [DEBUG] -- gather_log_on_node 192.168.0.26 done [2025-12-08 16:09:26.260] [DEBUG] - start get gather_tuples [2025-12-08 16:09:26.261] [DEBUG] - gather_tuples: [{'node': 'remote_192_168_0_26', 'success': 'Success', 'info': 'file save in /root/obdiag_gather_pack_20251208160917/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz', 'file_size': '12.940K', 'file_path': '/root/obdiag_gather_pack_20251208160917/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz'}] [2025-12-08 16:09:26.261] [DEBUG] - node_summary_tuple: [{'node': 'remote_192_168_0_26', 'success': 'Success', 'info': 'file save in /root/obdiag_gather_pack_20251208160917/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz', 'file_size': '12.940K', 'file_path': '/root/obdiag_gather_pack_20251208160917/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz'}] [2025-12-08 16:09:26.262] [INFO] +-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ [2025-12-08 16:09:26.262] [INFO] | Gather observer Log Summary on 2025-12-08 16:09:26 | [2025-12-08 16:09:26.262] [INFO] +---------------------+---------+---------+-----------------------------------------------------------------------------------------------------------------------------------+ [2025-12-08 16:09:26.262] [INFO] | Node | Status | Size | info | [2025-12-08 16:09:26.262] [INFO] +---------------------+---------+---------+-----------------------------------------------------------------------------------------------------------------------------------+ [2025-12-08 16:09:26.262] [INFO] | remote_192_168_0_26 | Success | 12.940K | file save in /root/obdiag_gather_pack_20251208160917/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz | [2025-12-08 16:09:26.263] [INFO] +---------------------+---------+---------+-----------------------------------------------------------------------------------------------------------------------------------+ [2025-12-08 16:09:26.295] [INFO] +-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ [2025-12-08 16:09:26.295] [INFO] | Gather observer Log Summary on 2025-12-08 16:09:26 | [2025-12-08 16:09:26.295] [INFO] +---------------------+---------+---------+-----------------------------------------------------------------------------------------------------------------------------------+ [2025-12-08 16:09:26.295] [INFO] | Node | Status | Size | info | [2025-12-08 16:09:26.295] [INFO] +---------------------+---------+---------+-----------------------------------------------------------------------------------------------------------------------------------+ [2025-12-08 16:09:26.295] [INFO] | remote_192_168_0_26 | Success | 12.940K | file save in /root/obdiag_gather_pack_20251208160917/observer_log_remote_192_168_0_26_20251208153921_20251208161021_e90c12.tar.gz | [2025-12-08 16:09:26.295] [INFO] +---------------------+---------+---------+-----------------------------------------------------------------------------------------------------------------------------------+ [2025-12-08 16:09:26.295] [INFO] [2025-12-08 16:09:26.295] [INFO] For result details, please run cmd ' cat /root/obdiag_gather_pack_20251208160917/result_summary.txt ' [2025-12-08 16:09:26.295] [INFO] [2025-12-08 16:09:26.295] [DEBUG] - gather observer log end [2025-12-08 16:09:26.295] [DEBUG] - gather obproxy log start [2025-12-08 16:09:26.296] [WARNING] obproxy nodes is None. Skipping gathering obproxy log. [2025-12-08 16:09:26.296] [DEBUG] - gather sql info start [2025-12-08 16:09:26.296] [DEBUG] - gather sql info set_variable, key: gather_plan_monitor_trace_id, value:YB42C0A8001A-000644EA3E986579-0-0 [2025-12-08 16:09:26.299] [DEBUG] -- connect databse ... [2025-12-08 16:09:26.303] [DEBUG] -- connect databse ... [2025-12-08 16:09:26.306] [DEBUG] -- Detected MySQL mode successful, Database version: OceanBase_CE 4.4.1.0 (r100000032025101610-70824e90816ed333c56f3dd1af34ffec43d0fa88) (Built Oct 16 2025 10:13:49) [2025-12-08 16:09:26.306] [DEBUG] -- Use /root/obdiag_gather_pack_20251208160917 as pack dir. [2025-12-08 16:09:26.306] [DEBUG] -- mkdir /root/obdiag_gather_pack_20251208160917 [2025-12-08 16:09:26.306] [DEBUG] -- [cs resource path] : /opt/oceanbase-diagnostic-tool/resources [2025-12-08 16:09:26.308] [DEBUG] -- [sql plan monitor report task] start [2025-12-08 16:09:26.716] [DEBUG] -- TraceID : YB42C0A8001A-000644EA3E986579-0-0 [2025-12-08 16:09:26.716] [DEBUG] -- SQL : SELECT /*ligang1603*/ a.order_id, a.use_type, ( SELECT COUNT( 1 ) FROM t_order_file g,t_file h WHERE g.order_id = a.order_id AND h.file_id = g.file_id AND (h.sensi_flag is null OR h.sensi_flag in (1,1000))) unfinished_count, ( SELECT COUNT( 1 ) FROM t_order_file g,t_file h WHERE g.order_id = a.order_id AND h.file_id = g.file_id AND h.sensi_flag in (2,96,97) ) sensi_count, ( SELECT COUNT( 1 ) FROM t_order_file g,t_file h WHERE g.order_id = a.order_id AND h.file_id = g.file_id AND h.sensi_flag in (98,99)) black_count, u.censor_flag,u.sensi_handle_flag FROM t_order a LEFT JOIN t_set s ON a.set_id = s.set_id LEFT JOIN t_set_security_policy t on s.set_id = t.set_id LEFT JOIN t_security_policy u on t.policy_id = u.policy_id WHERE a.state_date > DATE_ADD(now(),INTERVAL - 3 HOUR) and a.r_tenant_id = 'woqu' AND a.state_date < DATE_ADD(now(),INTERVAL - 60 SECOND) AND a.state = '00' AND a.checked_flag is null [2025-12-08 16:09:26.716] [DEBUG] -- SVR_IP : 192.168.0.26 [2025-12-08 16:09:26.716] [DEBUG] -- SVR_PORT : 2882 [2025-12-08 16:09:26.716] [DEBUG] -- DB: cprint [2025-12-08 16:09:26.716] [DEBUG] -- PLAN_ID: 135532 [2025-12-08 16:09:26.716] [DEBUG] -- TENANT_NAME: woqu [2025-12-08 16:09:26.716] [DEBUG] -- TENANT_ID: 1002 [2025-12-08 16:09:26.716] [DEBUG] -- [sql plan monitor report task] report header [2025-12-08 16:09:26.716] [DEBUG] -- report header complete [2025-12-08 16:09:26.716] [DEBUG] -- [sql plan monitor report task] report sql_audit [2025-12-08 16:09:26.717] [DEBUG] -- select sql_audit from ob with SQL: [2025-12-08 16:09:27.150] [DEBUG] -- sql_audit_result: +-----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-------------+----------------------------+----------------------------+--------------+-------------+-----------+---------+---------+-----------+------------------------------+--------------+----------+--------------+ [2025-12-08 16:09:27.153] [DEBUG] -- report sql_audit_result to file start ... [2025-12-08 16:09:27.153] [DEBUG] -- report sql_audit_result end [2025-12-08 16:09:27.153] [DEBUG] -- [sql plan monitor report task] report plan explain, sql: [SELECT /*ligang1603*/ a.order_id, a.use_type, ( SELECT COUNT( 1 ) FROM t_order_file g,t_file h WHERE g.order_id = a.order_id AND h.file_id = g.file_id AND (h.sensi_flag is null OR h.sensi_flag in (1,1000))) unfinished_count, ( SELECT COUNT( 1 ) FROM t_order_file g,t_file h WHERE g.order_id = a.order_id AND h.file_id = g.file_id AND h.sensi_flag in (2,96,97) ) sensi_count, ( SELECT COUNT( 1 ) FROM t_order_file g,t_file h WHERE g.order_id = a.order_id AND h.file_id = g.file_id AND h.sensi_flag in (98,99)) black_count, u.censor_flag,u.sensi_handle_flag FROM t_order a LEFT JOIN t_set s ON a.set_id = s.set_id LEFT JOIN t_set_security_policy t on s.set_id = t.set_id LEFT JOIN t_security_policy u on t.policy_id = u.policy_id WHERE a.state_date > DATE_ADD(now(),INTERVAL - 3 HOUR) and a.r_tenant_id = 'woqu' AND a.state_date < DATE_ADD(now(),INTERVAL - 60 SECOND) AND a.state = '00' AND a.checked_flag is null] [2025-12-08 16:09:27.193] [DEBUG] -- execute SQL: explain extended SELECT /*ligang1603*/ a.order_id, a.use_type, ( SELECT COUNT( 1 ) FROM t_order_file g,t_file h WHERE g.order_id = a.order_id AND h.file_id = g.file_id AND (h.sensi_flag is null OR h.sensi_flag in (1,1000))) unfinished_count, ( SELECT COUNT( 1 ) FROM t_order_file g,t_file h WHERE g.order_id = a.order_id AND h.file_id = g.file_id AND h.sensi_flag in (2,96,97) ) sensi_count, ( SELECT COUNT( 1 ) FROM t_order_file g,t_file h WHERE g.order_id = a.order_id AND h.file_id = g.file_id AND h.sensi_flag in (98,99)) black_count, u.censor_flag,u.sensi_handle_flag FROM t_order a LEFT JOIN t_set s ON a.set_id = s.set_id LEFT JOIN t_set_security_policy t on s.set_id = t.set_id LEFT JOIN t_security_policy u on t.policy_id = u.policy_id WHERE a.state_date > DATE_ADD(now(),INTERVAL - 3 HOUR) and a.r_tenant_id = 'woqu' AND a.state_date < DATE_ADD(now(),INTERVAL - 60 SECOND) AND a.state = '00' AND a.checked_flag is null [2025-12-08 16:09:27.624] [INFO] cprint.t_order_file -> oceanbase.DBA_OB_TABLE_STAT_STALE_INFO IS_STALE=NO [2025-12-08 16:09:27.656] [INFO] cprint.t_order_file -> oceanbase.DBA_OB_TABLE_STAT_STALE_INFO IS_STALE=NO [2025-12-08 16:09:27.688] [INFO] cprint.t_order_file -> oceanbase.DBA_OB_TABLE_STAT_STALE_INFO IS_STALE=NO [2025-12-08 16:09:27.714] [INFO] cprint.t_order -> oceanbase.DBA_OB_TABLE_STAT_STALE_INFO IS_STALE=NO [2025-12-08 16:09:27.741] [INFO] cprint.t_set -> oceanbase.DBA_OB_TABLE_STAT_STALE_INFO IS_STALE=NO [2025-12-08 16:09:27.770] [INFO] cprint.t_set_security_policy -> oceanbase.DBA_OB_TABLE_STAT_STALE_INFO IS_STALE=NO [2025-12-08 16:09:27.794] [INFO] cprint.t_security_policy -> oceanbase.DBA_OB_TABLE_STAT_STALE_INFO IS_STALE=YES [2025-12-08 16:09:27.850] [DEBUG] -- The statistics are up-to-date. The last collection time for the a table is 2025-12-07 22:00:46,No action needed. [2025-12-08 16:09:27.850] [DEBUG] -- The statistics are up-to-date. The last collection time for the s table is 2025-12-03 07:35:07,No action needed. [2025-12-08 16:09:27.851] [DEBUG] -- The statistics are up-to-date. The last collection time for the t table is 2025-12-03 07:35:05,No action needed. [2025-12-08 16:09:27.851] [DEBUG] -- The statistics are up-to-date. The last collection time for the u table is 2025-12-03 07:35:09,No action needed. [2025-12-08 16:09:27.851] [DEBUG] -- The statistics are up-to-date. The last collection time for the h table is 2025-12-05 22:01:06,No action needed. [2025-12-08 16:09:27.851] [DEBUG] -- The statistics are up-to-date. The last collection time for the g table is 2025-12-07 22:01:11,No action needed. [2025-12-08 16:09:27.851] [DEBUG] -- Could not find stats version information for the Parameters table. [2025-12-08 16:09:27.851] [DEBUG] -- Could not find stats version information for the Expr Constraints table. [2025-12-08 16:09:27.851] [DEBUG] -- the result of optimization_info_warn is None [2025-12-08 16:09:27.851] [DEBUG] -- report sql_explain_result_sql complete [2025-12-08 16:09:27.851] [DEBUG] -- report sql_explain_result_sql complete [2025-12-08 16:09:27.908] [DEBUG] -- report sql_explain_result complete [2025-12-08 16:09:27.908] [DEBUG] -- [sql plan monitor report task] report plan cache [2025-12-08 16:09:27.919] [DEBUG] -- select plan_explain from ob complete [2025-12-08 16:09:27.919] [DEBUG] -- report plan_explain_sql complete [2025-12-08 16:09:27.940] [DEBUG] -- report plan_explain complete [2025-12-08 16:09:27.941] [INFO] execute SQL: SELECT DBMS_XPLAN.DISPLAY_CURSOR(135532, 'all', '192.168.0.26', 2882, 1002) FROM DUAL [2025-12-08 16:09:28.324] [DEBUG] -- display_cursor report complete [2025-12-08 16:09:28.324] [DEBUG] -- [sql plan monitor report task] report table schema [2025-12-08 16:09:28.327] [DEBUG] -- connect databse ... [2025-12-08 16:09:28.330] [DEBUG] -- connect databse ... [2025-12-08 16:09:28.331] [DEBUG] -- get observer version, by sql [2025-12-08 16:09:28.331] [DEBUG] -- start get_observer_version_by_sql . input: 127.0.0.1:2881 [2025-12-08 16:09:28.334] [DEBUG] -- connect databse ... [2025-12-08 16:09:28.335] [DEBUG] -- get_observer_version_by_sql ob_version_info is ('5.7.25-OceanBase_CE-v4.4.1.0',) [2025-12-08 16:09:28.473] [INFO] table count (('t_order_file', 19236902),) [2025-12-08 16:09:41.404] [INFO] data size (('192.168.0.138', 'cprint', 't_order_file', 'USER TABLE', Decimal('1944.20'), Decimal('1944.20')), ('192.168.0.138', 'cprint', '', 'INDEX', Decimal('823.02'), Decimal('823.02')), ('192.168.0.26', 'cprint', 't_order_file', 'USER TABLE', Decimal('1944.20'), Decimal('1944.20')), ('192.168.0.26', 'cprint', '', 'INDEX', Decimal('823.02'), Decimal('823.02')), ('192.168.0.33', 'cprint', 't_order_file', 'USER TABLE', Decimal('1944.20'), Decimal('1944.20')), ('192.168.0.33', 'cprint', '', 'INDEX', Decimal('823.02'), Decimal('823.02'))) [2025-12-08 16:09:41.409] [DEBUG] -- connect databse ... [2025-12-08 16:09:41.412] [DEBUG] -- connect databse ... [2025-12-08 16:09:41.414] [DEBUG] -- get observer version, by sql [2025-12-08 16:09:41.414] [DEBUG] -- start get_observer_version_by_sql . input: 127.0.0.1:2881 [2025-12-08 16:09:41.416] [DEBUG] -- connect databse ... [2025-12-08 16:09:41.417] [DEBUG] -- get_observer_version_by_sql ob_version_info is ('5.7.25-OceanBase_CE-v4.4.1.0',) [2025-12-08 16:09:41.476] [INFO] table count (('t_order_file', 19236902),) [2025-12-08 16:09:52.770] [INFO] data size (('192.168.0.138', 'cprint', 't_order_file', 'USER TABLE', Decimal('1944.20'), Decimal('1944.20')), ('192.168.0.138', 'cprint', '', 'INDEX', Decimal('823.02'), Decimal('823.02')), ('192.168.0.26', 'cprint', 't_order_file', 'USER TABLE', Decimal('1944.20'), Decimal('1944.20')), ('192.168.0.26', 'cprint', '', 'INDEX', Decimal('823.02'), Decimal('823.02')), ('192.168.0.33', 'cprint', 't_order_file', 'USER TABLE', Decimal('1944.20'), Decimal('1944.20')), ('192.168.0.33', 'cprint', '', 'INDEX', Decimal('823.02'), Decimal('823.02'))) [2025-12-08 16:09:52.775] [DEBUG] -- connect databse ... [2025-12-08 16:09:52.780] [DEBUG] -- connect databse ... [2025-12-08 16:09:52.782] [DEBUG] -- get observer version, by sql [2025-12-08 16:09:52.782] [DEBUG] -- start get_observer_version_by_sql . input: 127.0.0.1:2881 [2025-12-08 16:09:52.785] [DEBUG] -- connect databse ... [2025-12-08 16:09:52.787] [DEBUG] -- get_observer_version_by_sql ob_version_info is ('5.7.25-OceanBase_CE-v4.4.1.0',) [2025-12-08 16:09:52.855] [INFO] table count (('t_order_file', 19236902),) [2025-12-08 16:10:04.803] [INFO] data size (('192.168.0.138', 'cprint', 't_order_file', 'USER TABLE', Decimal('1944.20'), Decimal('1944.20')), ('192.168.0.138', 'cprint', '', 'INDEX', Decimal('823.02'), Decimal('823.02')), ('192.168.0.26', 'cprint', 't_order_file', 'USER TABLE', Decimal('1944.20'), Decimal('1944.20')), ('192.168.0.26', 'cprint', '', 'INDEX', Decimal('823.02'), Decimal('823.02')), ('192.168.0.33', 'cprint', 't_order_file', 'USER TABLE', Decimal('1944.20'), Decimal('1944.20')), ('192.168.0.33', 'cprint', '', 'INDEX', Decimal('823.02'), Decimal('823.02'))) [2025-12-08 16:10:04.809] [DEBUG] -- connect databse ... [2025-12-08 16:10:04.813] [DEBUG] -- connect databse ... [2025-12-08 16:10:04.815] [DEBUG] -- get observer version, by sql [2025-12-08 16:10:04.815] [DEBUG] -- start get_observer_version_by_sql . input: 127.0.0.1:2881 [2025-12-08 16:10:04.825] [DEBUG] -- connect databse ... [2025-12-08 16:10:04.827] [DEBUG] -- get_observer_version_by_sql ob_version_info is ('5.7.25-OceanBase_CE-v4.4.1.0',) [2025-12-08 16:10:04.953] [INFO] table count (('t_order', 14148572),) [2025-12-08 16:10:16.537] [INFO] data size (('192.168.0.138', 'cprint', 't_order', 'USER TABLE', Decimal('289.07'), Decimal('289.07')), ('192.168.0.138', 'cprint', '', 'INDEX', Decimal('868.57'), Decimal('868.57')), ('192.168.0.26', 'cprint', 't_order', 'USER TABLE', Decimal('289.07'), Decimal('289.07')), ('192.168.0.26', 'cprint', '', 'INDEX', Decimal('868.57'), Decimal('868.57')), ('192.168.0.33', 'cprint', 't_order', 'USER TABLE', Decimal('289.07'), Decimal('289.07')), ('192.168.0.33', 'cprint', '', 'INDEX', Decimal('868.57'), Decimal('868.57'))) [2025-12-08 16:10:16.542] [DEBUG] -- connect databse ... [2025-12-08 16:10:16.546] [DEBUG] -- connect databse ... [2025-12-08 16:10:16.547] [DEBUG] -- get observer version, by sql [2025-12-08 16:10:16.547] [DEBUG] -- start get_observer_version_by_sql . input: 127.0.0.1:2881 [2025-12-08 16:10:16.550] [DEBUG] -- connect databse ... [2025-12-08 16:10:16.552] [DEBUG] -- get_observer_version_by_sql ob_version_info is ('5.7.25-OceanBase_CE-v4.4.1.0',) [2025-12-08 16:10:16.617] [INFO] table count (('t_set', 363),) [2025-12-08 16:10:27.865] [INFO] data size (('192.168.0.138', 'cprint', '__AUX_LOB_META_502312_', 'LOB AUX TABLE', Decimal('0.00'), Decimal('0.00')), ('192.168.0.138', 'cprint', 't_set', 'USER TABLE', Decimal('0.03'), Decimal('0.04')), ('192.168.0.138', 'cprint', '', 'INDEX', Decimal('0.00'), Decimal('0.00')), ('192.168.0.26', 'cprint', '__AUX_LOB_META_502312_', 'LOB AUX TABLE', Decimal('0.00'), Decimal('0.00')), ('192.168.0.26', 'cprint', 't_set', 'USER TABLE', Decimal('0.03'), Decimal('0.04')), ('192.168.0.26', 'cprint', '', 'INDEX', Decimal('0.00'), Decimal('0.00')), ('192.168.0.33', 'cprint', '__AUX_LOB_META_502312_', 'LOB AUX TABLE', Decimal('0.00'), Decimal('0.00')), ('192.168.0.33', 'cprint', 't_set', 'USER TABLE', Decimal('0.03'), Decimal('0.04')), ('192.168.0.33', 'cprint', '', 'INDEX', Decimal('0.00'), Decimal('0.00'))) [2025-12-08 16:10:27.872] [DEBUG] -- connect databse ... [2025-12-08 16:10:27.876] [DEBUG] -- connect databse ... [2025-12-08 16:10:27.877] [DEBUG] -- get observer version, by sql [2025-12-08 16:10:27.878] [DEBUG] -- start get_observer_version_by_sql . input: 127.0.0.1:2881 [2025-12-08 16:10:27.880] [DEBUG] -- connect databse ... [2025-12-08 16:10:27.882] [DEBUG] -- get_observer_version_by_sql ob_version_info is ('5.7.25-OceanBase_CE-v4.4.1.0',) [2025-12-08 16:10:27.946] [INFO] table count (('t_set_security_policy', 334),) [2025-12-08 16:10:39.551] [INFO] data size (('192.168.0.138', 'cprint', 't_set_security_policy', 'USER TABLE', Decimal('0.00'), Decimal('0.00')), ('192.168.0.138', 'cprint', '', 'INDEX', Decimal('0.00'), Decimal('0.00')), ('192.168.0.26', 'cprint', 't_set_security_policy', 'USER TABLE', Decimal('0.00'), Decimal('0.00')), ('192.168.0.26', 'cprint', '', 'INDEX', Decimal('0.00'), Decimal('0.00')), ('192.168.0.33', 'cprint', 't_set_security_policy', 'USER TABLE', Decimal('0.00'), Decimal('0.00')), ('192.168.0.33', 'cprint', '', 'INDEX', Decimal('0.00'), Decimal('0.00'))) [2025-12-08 16:10:39.557] [DEBUG] -- connect databse ... [2025-12-08 16:10:39.569] [DEBUG] -- connect databse ... [2025-12-08 16:10:39.570] [DEBUG] -- get observer version, by sql [2025-12-08 16:10:39.571] [DEBUG] -- start get_observer_version_by_sql . input: 127.0.0.1:2881 [2025-12-08 16:10:39.573] [DEBUG] -- connect databse ... [2025-12-08 16:10:39.575] [DEBUG] -- get_observer_version_by_sql ob_version_info is ('5.7.25-OceanBase_CE-v4.4.1.0',) [2025-12-08 16:10:39.638] [INFO] table count (('t_security_policy', 6),) [2025-12-08 16:10:50.362] [INFO] data size (('192.168.0.138', 'cprint', 't_security_policy', 'USER TABLE', Decimal('0.00'), Decimal('0.00')), ('192.168.0.26', 'cprint', 't_security_policy', 'USER TABLE', Decimal('0.00'), Decimal('0.00')), ('192.168.0.33', 'cprint', 't_security_policy', 'USER TABLE', Decimal('0.00'), Decimal('0.00'))) [2025-12-08 16:10:50.363] [DEBUG] -- table info file path:/root/obdiag_gather_pack_20251208160917/obdiag_tabledump_result_20251208160917.txt [2025-12-08 16:10:51.288] [DEBUG] -- [ash report task] report ash, sql: [ [2025-12-08 16:10:51.288] [DEBUG] SELECT SQL_PLAN_LINE_ID OP_ID, IF(EVENT = '', 'CPU + WAIT FOR CPU', EVENT) AS EVENT, WAIT_CLASS, COUNT(1) EVENT_CNT, ROUND(COUNT(1) * 100 / SUM(COUNT(1)) OVER (), 2) AS Percent, MAX(P1TEXT) P1TEXT, MAX(P1) P1, MAX(P2TEXT) P2TEXT, MAX(P2) P2, MAX(P3TEXT) P3TEXT, MAX(P3) P3 [2025-12-08 16:10:51.288] [DEBUG] FROM OCEANBASE.GV$ACTIVE_SESSION_HISTORY A WHERE CON_ID = 1002 AND TRACE_ID = 'YB42C0A8001A-000644EA3E986579-0-0' GROUP BY A.SQL_PLAN_LINE_ID, A.EVENT, A.WAIT_CLASS ORDER BY 1 ASC, 4 DESC [2025-12-08 16:10:51.288] [DEBUG] ] [2025-12-08 16:10:51.413] [DEBUG] -- execute SQL: [2025-12-08 16:10:51.415] [DEBUG] -- ash report complete [2025-12-08 16:10:51.430] [DEBUG] -- init sql plan monitor stat complete [2025-12-08 16:10:51.430] [DEBUG] -- [sql plan monitor report task] report sql_audit details [2025-12-08 16:10:52.568] [DEBUG] -- report full sql audit complete [2025-12-08 16:10:52.568] [DEBUG] -- [sql plan monitor report task] report sql plan monitor dfo [2025-12-08 16:10:52.811] [DEBUG] -- report SQL_PLAN_MONITOR DFO complete [2025-12-08 16:10:53.033] [DEBUG] -- report SQL_PLAN_MONITOR DFO SCHED complete [2025-12-08 16:10:53.248] [DEBUG] -- report SQL_PLAN_MONITOR DFO graph data complete [2025-12-08 16:10:53.248] [DEBUG] -- [db time display task] report db time display [2025-12-08 16:10:53.413] [DEBUG] -- execute SQL: [2025-12-08 16:10:53.413] [DEBUG] -- DB Time display complete [2025-12-08 16:10:53.413] [DEBUG] -- report db time display complete [2025-12-08 16:10:53.413] [DEBUG] -- [sql plan monitor report task] report sql plan monitor group by server [2025-12-08 16:10:53.617] [DEBUG] -- report SQL_PLAN_MONITOR SQC complete [2025-12-08 16:10:53.832] [DEBUG] -- report SQL_PLAN_MONITOR SQC operator priority start, DATA:
算子优先视图
[2025-12-08 16:10:53.834] [DEBUG] -- report SQL_PLAN_MONITOR SQC operator priority complete [2025-12-08 16:10:54.041] [DEBUG] -- report SQL_PLAN_MONITOR SQC operator priority start, DATA:机器优先视图
[2025-12-08 16:10:54.041] [DEBUG] -- report SQL_PLAN_MONITOR SQC server priority complete [2025-12-08 16:10:54.041] [DEBUG] -- report SQL_PLAN_MONITOR fast preview complete [2025-12-08 16:10:54.041] [DEBUG] -- [sql plan monitor report task] sql plan monitor detail operator [2025-12-08 16:10:54.274] [DEBUG] -- report SQL_PLAN_MONITOR details complete [2025-12-08 16:10:54.513] [DEBUG] -- report SQL_PLAN_MONITOR details operator priority complete [2025-12-08 16:10:54.513] [DEBUG] -- [sql plan monitor report task] sql plan monitor group by priority [2025-12-08 16:10:54.783] [DEBUG] -- report SQL_PLAN_MONITOR details server priority complete [2025-12-08 16:10:54.784] [DEBUG] -- get observer commit id, by sql [2025-12-08 16:10:54.786] [DEBUG] -- connect databse ... [2025-12-08 16:10:54.790] [DEBUG] -- report footer complete [2025-12-08 16:10:54.790] [DEBUG] -- [sql plan monitor report task] end [2025-12-08 16:10:54.791] [INFO] [2025-12-08 16:10:54.791] [INFO] Gather Sql Plan Monitor Summary: [2025-12-08 16:10:54.791] [INFO] +-----------+-----------+--------+-----------------------------------------+ [2025-12-08 16:10:54.791] [INFO] | Cluster | Status | Time | PackPath | [2025-12-08 16:10:54.791] [INFO] +===========+===========+========+=========================================+ [2025-12-08 16:10:54.792] [INFO] | | Completed | 88 s | /root/obdiag_gather_pack_20251208160917 | [2025-12-08 16:10:54.792] [INFO] +-----------+-----------+--------+-----------------------------------------+ [2025-12-08 16:10:54.792] [DEBUG] - gather sql info end [2025-12-08 16:10:54.793] [DEBUG] - gather dbms_xplan_opt_trace start [2025-12-08 16:10:54.793] [DEBUG] - gather dbms_xplan_opt_trace set_variable, key: gather_trace_id, value:YB42C0A8001A-000644EA3E986579-0-0, key: dbms_xplan_scope, value opt_trace [2025-12-08 16:10:54.796] [DEBUG] -- connect databse ... [2025-12-08 16:10:54.799] [DEBUG] -- connect databse ... [2025-12-08 16:10:54.801] [DEBUG] -- get observer version, by sql [2025-12-08 16:10:54.801] [DEBUG] -- start get_observer_version_by_sql . input: 127.0.0.1:2881 [2025-12-08 16:10:54.803] [DEBUG] -- connect databse ... [2025-12-08 16:10:54.805] [DEBUG] -- get_observer_version_by_sql ob_version_info is ('5.7.25-OceanBase_CE-v4.4.1.0',) [2025-12-08 16:10:55.180] [ERROR] The data queried with the specified trace_id YB42C0A8001A-000644EA3E986579-0-0 from gv$ob_sql_audit is empty. Please verify if this trace_id has expired. [2025-12-08 16:10:55.272] [DEBUG] -- node: remote_192_168_0_138. recycle *_obdiag_*.trac in observer log dir. obdiag will clean all '*_obdiag_*.trac' [2025-12-08 16:10:55.273] [DEBUG] -- Execute Shell command on server 192.168.0.138:find /data1/myoceanbase/oceanbase/log -type f -name '*_obdiag_*.trac' -exec rm -f {} + [2025-12-08 16:10:55.498] [DEBUG] -- node: remote_192_168_0_26. recycle *_obdiag_*.trac in observer log dir. obdiag will clean all '*_obdiag_*.trac' [2025-12-08 16:10:55.499] [DEBUG] -- Execute Shell command on server 192.168.0.26:find /data1/myoceanbase/oceanbase/log -type f -name '*_obdiag_*.trac' -exec rm -f {} + [2025-12-08 16:10:55.684] [DEBUG] -- node: remote_192_168_0_33. recycle *_obdiag_*.trac in observer log dir. obdiag will clean all '*_obdiag_*.trac' [2025-12-08 16:10:55.684] [DEBUG] -- Execute Shell command on server 192.168.0.33:find /data1/myoceanbase/oceanbase/log -type f -name '*_obdiag_*.trac' -exec rm -f {} + [2025-12-08 16:10:55.811] [DEBUG] - gather dbms_xplan_opt_trace end [2025-12-08 16:10:55.812] [DEBUG] - execute tasks end : observer.perf_sql [2025-12-08 16:10:55.812] [INFO] [2025-12-08 16:10:55.812] [INFO] Gather scene results stored in this directory: /root/obdiag_gather_pack_20251208160917 [2025-12-08 16:10:55.812] [INFO] [2025-12-08 16:10:55.812] [INFO] Trace ID: 312526a0-d40d-11f0-9eb1-fa163eec445e [2025-12-08 16:10:55.813] [INFO] If you want to view detailed obdiag logs, please run: obdiag display-trace 312526a0-d40d-11f0-9eb1-fa163eec445e