2023-07-21T16:52:09.43057+08:00 INFO [24352,] caller=sdk/sdk_init.go:43:InitSDK: init sdk conf {ConfigPropertiesDir:conf/config_properties ModuleConfigDir:conf/module_config CryptoPath:conf/.config_secret.key CryptoMethod:plain} 2023-07-21T16:52:09.43244+08:00 INFO [24352,] caller=config/config_reader_writer.go:218:loadYamlFilesFromPath: read config files from path /home/admin/obagent/conf/config_properties 2023-07-21T16:52:09.43313+08:00 INFO [24352,] caller=config/config_reader_writer.go:224:loadYamlFilesFromPath: read config from path /home/admin/obagent/conf/config_properties, files length 2 2023-07-21T16:52:09.44347+08:00 INFO [24352,] caller=config/config_reader_writer.go:218:loadYamlFilesFromPath: read config files from path /home/admin/obagent/conf/module_config 2023-07-21T16:52:09.444+08:00 INFO [24352,] caller=config/config_reader_writer.go:224:loadYamlFilesFromPath: read config from path /home/admin/obagent/conf/module_config, files length 6 2023-07-21T16:52:09.59775+08:00 INFO [24352,] caller=monagent/main.go:100:runMonitorAgent: sdk inited 2023-07-21T16:52:09.60027+08:00 INFO [24352,] caller=sdk/monagent_callbacks.go:104:func8: module monagent.admin.basic.auth init config sucessfully 2023-07-21T16:52:09.60247+08:00 INFO [24352,] caller=sdk/monagent_callbacks.go:73:func5: module monagent.server.basic.auth init config sucessfully 2023-07-21T16:52:09.6198+08:00 WARN [24352,] caller=engine/pipeline_module_callback.go:115:InitPipelineModuleCallback: pipeline module monitor.mysql is inactive, just skip 2023-07-21T16:52:09.64123+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=info, fields.msg="Parsed flag --collector.filesystem.mount-points-exclude", flag="^/(dev|proc|sys|var/lib/docker/.+)($|/)" 2023-07-21T16:52:09.64221+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=info, fields.msg="Parsed flag --collector.filesystem.fs-types-exclude", flag="^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$" 2023-07-21T16:52:09.67039+08:00 INFO [24352,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:HOST svr_ip:172.118.81.152]} 2023-07-21T16:52:09.67121+08:00 INFO [24352,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T16:52:09.67155+08:00 INFO [24352,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/node/host 2023-07-21T16:52:09.67223+08:00 INFO [24352,] caller=engine/pipeline_module_callback.go:33:addPipeline: add pipeline module result succeed 2023-07-21T16:52:10.02129+08:00 INFO [24352,] caller=mysql/table_input.go:144:Init: table input init with config&{0 0xc0002a74a0 map[ob_is_rootservice:false ob_is_v3:false ob_is_v4:false ob_svr_ip:172.118.81.152 ob_svr_port:2882] [0xc0001a2080 0xc0001a2100 0xc0001a2180 0xc0001a2280 0xc0001a2300 0xc0001a2380 0xc0001a2400 0xc0001a2480 0xc0001a2500 0xc0001a2580 0xc0001a2600 0xc0001a2680 0xc0001a2700 0xc0001a2780 0xc0001a2800 0xc0001a2880] 4} 2023-07-21T16:52:10.04579+08:00 INFO [24352,] caller=mysql/table_input.go:161:Init: successfully init mysql table input plugin 2023-07-21T16:52:10.04868+08:00 INFO [24352,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:OB ob_cluster_id:20230720 ob_cluster_name:obce-3zones obzone:zone2 svr_ip:172.118.81.152]} 2023-07-21T16:52:10.04925+08:00 INFO [24352,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T16:52:10.09728+08:00 INFO [24352,] caller=mysql/table_input.go:144:Init: table input init with config&{0 0xc000388580 map[ob_is_rootservice:false ob_is_v3:false ob_is_v4:false ob_svr_ip:172.118.81.152 ob_svr_port:2882] [0xc00012d680 0xc00012d700 0xc00012d780 0xc00012d800 0xc00012d880 0xc00012d900 0xc00012d980 0xc00012da00 0xc00012da80 0xc00012db00 0xc00012db80 0xc00012dc00 0xc00012dc80 0xc00012dd00] 4} 2023-07-21T16:52:10.14303+08:00 INFO [24352,] caller=mysql/table_input.go:161:Init: successfully init mysql table input plugin 2023-07-21T16:52:10.14473+08:00 INFO [24352,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:OB ob_cluster_id:20230720 ob_cluster_name:obce-3zones obzone:zone2 svr_ip:172.118.81.152]} 2023-07-21T16:52:10.14519+08:00 INFO [24352,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T16:52:10.14546+08:00 INFO [24352,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/ob/basic 2023-07-21T16:52:10.14582+08:00 INFO [24352,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/ob/extra 2023-07-21T16:52:10.14624+08:00 INFO [24352,] caller=engine/pipeline_module_callback.go:33:addPipeline: add pipeline module result succeed 2023-07-21T16:52:10.15677+08:00 WARN [24352,] caller=engine/pipeline_module_callback.go:115:InitPipelineModuleCallback: pipeline module monitor.ob.log is inactive, just skip 2023-07-21T16:52:10.57147+08:00 INFO [24352,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server 2023-07-21T16:52:10.57215+08:00 INFO [24352,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server 2023-07-21T16:52:10.57275+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:10.57554+08:00 INFO [24352,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_partition 2023-07-21T16:52:10.57603+08:00 INFO [24352,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_partition 2023-07-21T16:52:10.54754+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:10.58525+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:10.767+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:10.77268+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:10.78103+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:10.78134+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ group_concat(svr_ip SEPARATOR ',') as servers, status, count(1) as cnt from __all_server group by status 2023-07-21T16:52:10.8078+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) QUERY_TIMEOUT(100000000) */ tenant_name, 1 as role, case when cnt is null then 0 else cnt end as cnt from (select __all_tenant.tenant_name, t1.cnt from __all_tenant left join (select tenant_id, count(*) as cnt from __all_virtual_partition_info where svr_ip = ? and svr_port = ? group by tenant_id) t1 on __all_tenant.tenant_id = t1.tenant_id) t2 2023-07-21T16:52:10.8251+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T16:52:10.82602+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T16:52:10.82637+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T16:52:10.82585+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T16:52:10.82767+08:00 WARN [24352,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T16:52:11.18931+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T16:52:11.19593+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.003080695, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:11.53801+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.420318429, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:11.5493+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:11.56016+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:11.74274+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:11.74618+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:11.74665+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000926367, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:11.75637+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T16:52:11.93974+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.160560157, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:12.3375+08:00 INFO [24352,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_table 2023-07-21T16:52:12.41232+08:00 INFO [24352,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_disk 2023-07-21T16:52:12.38979+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:12.46074+08:00 INFO [24352,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_disk 2023-07-21T16:52:12.49131+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:12.45707+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T16:52:12.57057+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:12.47275+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=18.96 2023-07-21T16:52:12.61652+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:12.43466+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:12.65149+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=31.11 2023-07-21T16:52:12.65173+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.196084501, err="couldn't get SNTP reply: read udp 127.0.0.1:55393->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:12.65243+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.99 2023-07-21T16:52:12.68232+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:12.68337+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:12.69245+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:12.69275+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.235489131, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:12.8309+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:12.84531+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.297070992, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:12.69495+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:12.82957+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.139766313, err="couldn't get SNTP reply: read udp 127.0.0.1:35480->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:12.83359+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ total_size, free_size from __all_virtual_disk_stat where svr_ip = ? and svr_port = ? 2023-07-21T16:52:12.88785+08:00 INFO [24352,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_table 2023-07-21T16:52:12.89604+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:12.8846+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:12.90144+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:12.99163+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:12.99224+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:13.0414+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:12.90291+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:13.12972+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:13.1328+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:13.44042+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:13.44094+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:13.17879+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:13.48128+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:13.48187+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:13.13944+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.725477168, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:52:13.54063+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:13.54281+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:13.54342+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:13.55373+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:13.55321+08:00 INFO [24352,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T16:52:13.55867+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:13.55935+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:13.56058+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:13.56196+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:13.61545+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:13.61615+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:13.62103+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:13.62142+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:13.62181+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:13.62199+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:13.6332+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T16:52:13.635+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T16:52:13.64189+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:13.65882+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=18.96 2023-07-21T16:52:13.65888+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:13.64365+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) QUERY_TIMEOUT(100000000) */ tenant_name, count(*) as cnt from gv$table group by tenant_id 2023-07-21T16:52:13.64168+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000624419, err="couldn't get SNTP reply: read udp 127.0.0.1:48088->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:13.65895+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:13.65955+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:13.87322+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=18.96 2023-07-21T16:52:13.8745+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=31.11 2023-07-21T16:52:13.88736+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:13.88792+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:52:13.88852+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:52:13.88892+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:52:13.88945+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T16:52:13.88976+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T16:52:13.89144+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T16:52:13.87503+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:13.8753+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.99 2023-07-21T16:52:13.90714+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.034294208, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:13.90767+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T16:52:13.93548+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T16:52:13.93644+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T16:52:13.937+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T16:52:13.93753+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T16:52:13.93798+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T16:52:13.93851+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T16:52:13.93898+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T16:52:13.99046+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T16:52:14.12444+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T16:52:14.13325+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T16:52:14.13432+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T16:52:14.14448+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T16:52:14.16516+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:14.16792+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T16:52:14.266+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T16:52:14.39064+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.831808714, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T16:52:14.39847+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:14.39964+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:14.71942+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:14.82703+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:13.65936+08:00 INFO [24352,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T16:52:14.76355+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:14.90326+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T16:52:13.65942+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T16:52:14.82813+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=31.11 2023-07-21T16:52:14.91455+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.99 2023-07-21T16:52:14.9152+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.2566059090000001, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:14.91745+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:14.78332+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T16:52:14.9181+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:14.92115+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:14.9216+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:14.91994+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:14.69475+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.096793088e+10 Active_bytes:3.2138825728e+10 Active_file_bytes:1.170894848e+09 AnonHugePages_bytes:2.9565648896e+10 AnonPages_bytes:3.0964969472e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.654878208e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6683870208e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:397312 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:4.85609472e+08 Inactive_file_bytes:4.68303872e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.25739008e+08 MemAvailable_bytes:1.7509421056e+10 MemFree_bytes:1.6186155008e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.346176e+07 SReclaimable_bytes:8.1031168e+07 SUnreclaim_bytes:1.17567488e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98598656e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:14.99647+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.693612841, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:15.01861+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.01968+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.01983+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:15.02018+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.02069+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:52:15.02095+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.0214+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.02132+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:52:15.02193+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.0223+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.02219+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:52:15.02278+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.02269+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T16:52:15.02315+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.02328+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T16:52:15.02369+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.02383+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T16:52:15.02443+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T16:52:15.02488+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T16:52:15.02559+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T16:52:15.02608+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T16:52:15.02661+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T16:52:15.05738+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T16:52:15.05803+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T16:52:15.06854+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ cpu_total,cpu_assigned,mem_total,mem_assigned,disk_total,disk_assigned,unit_num,migrating_unit_num,cpu_assigned_percent, mem_assigned_percent, disk_assigned_percent from __all_virtual_server_stat where svr_ip = ? and svr_port = ? 2023-07-21T16:52:15.01853+08:00 WARN [24352,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T16:52:15.09178+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.0985490432e+10 Active_bytes:3.215640576e+10 Active_file_bytes:1.170915328e+09 AnonHugePages_bytes:2.9567746048e+10 AnonPages_bytes:3.0977343488e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.654902784e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6694528e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:421888 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85605376e+08 Inactive_file_bytes:4.68303872e+08 KernelStack_bytes:2.3969792e+07 Mapped_bytes:1.25763584e+08 MemAvailable_bytes:1.749266432e+10 MemFree_bytes:1.6169377792e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.360512e+07 SReclaimable_bytes:8.1031168e+07 SUnreclaim_bytes:1.1757568e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98606848e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:15.10137+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:15.06227+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.06218+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.283742964, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:15.17264+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.17313+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.17318+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T16:52:15.17373+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.1741+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.17402+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T16:52:15.32242+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T16:52:15.31187+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:15.41201+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T16:52:15.48952+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:15.49009+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.61117175, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:15.47882+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.49047+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T16:52:15.49371+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.49493+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T16:52:15.49518+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.49578+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.49682+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.49769+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.49897+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.49674+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:15.49954+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.50063+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.50522+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.50622+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.50678+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.50799+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu21, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.50858+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu21, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.5146+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu22, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.5156+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu22, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.51666+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu23, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.52177+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu23, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.5228+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu3, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.52341+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu3, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.52425+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu4, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:15.55556+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T16:52:15.63833+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(1) as cnt from __all_virtual_trans_stat where part_trans_action > 2 and ctx_create_time < date_sub(now(), interval 600 second) and svr_ip = ? and svr_port = ? 2023-07-21T16:52:15.73929+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(1) as cnt from __all_virtual_trans_stat where part_trans_action > 2 and ctx_create_time < date_sub(now(), interval 600 second) and svr_ip = ? and svr_port = ? 2023-07-21T16:52:15.72654+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:15.77938+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T16:52:15.71757+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:16.09244+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.454959741, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T16:52:16.10033+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:16.30345+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.007416689, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:16.41998+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T16:52:16.54095+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:16.4244+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:16.55231+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.439631431, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:16.74317+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:16.74416+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:16.80521+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:16.80599+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:16.80671+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:16.80717+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:16.80765+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:16.80822+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.937213532, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:52:16.33015+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.102785536e+10 Active_bytes:3.2198803456e+10 Active_file_bytes:1.170948096e+09 AnonHugePages_bytes:2.9578231808e+10 AnonPages_bytes:3.1018131456e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.654935552e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6713193472e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:454656 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:4.85609472e+08 Inactive_file_bytes:4.68303872e+08 KernelStack_bytes:2.3969792e+07 Mapped_bytes:1.25816832e+08 MemAvailable_bytes:1.7449975808e+10 MemFree_bytes:1.6126656512e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.3797632e+07 SReclaimable_bytes:8.1031168e+07 SUnreclaim_bytes:1.1757568e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98606848e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:16.96317+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T16:52:17.01566+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:17.02677+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T16:52:17.062+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:17.06464+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:17.06539+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:17.06603+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:17.0665+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:17.08076+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.416670686, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:17.14628+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000669349, err="couldn't get SNTP reply: read udp 127.0.0.1:39232->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:17.09862+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T16:52:17.1492+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:17.15464+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.116274121, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:17.32237+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:17.47537+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T16:52:17.47536+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T16:52:17.31063+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T16:52:17.47479+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T16:52:17.47476+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T16:52:17.47515+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T16:52:17.50467+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T16:52:17.53383+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T16:52:17.47555+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T16:52:17.53744+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T16:52:17.56271+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T16:52:17.56204+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T16:52:17.56293+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T16:52:17.53959+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:17.67348+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=24.65 2023-07-21T16:52:17.66641+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:17.80371+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.186022045, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:17.80405+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.611763717, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:17.80422+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.09 2023-07-21T16:52:17.70227+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T16:52:17.80784+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:17.80575+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T16:52:17.8089+08:00 WARN [24352,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T16:52:17.81257+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:17.89783+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T16:52:17.81623+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=32.31 2023-07-21T16:52:18.0385+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.365553421, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:17.99761+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T16:52:17.81672+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:18.04132+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:52:18.04196+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:52:18.04251+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:52:18.04309+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T16:52:18.0436+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T16:52:18.04009+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:18.04577+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:18.04421+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T16:52:18.04754+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T16:52:18.04817+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T16:52:18.04869+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T16:52:18.04917+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T16:52:18.04977+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T16:52:18.05026+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T16:52:18.05075+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T16:52:18.0516+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T16:52:18.0834+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T16:52:18.08396+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T16:52:18.08592+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T16:52:18.08374+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T16:52:18.15371+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:18.14074+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:18.20307+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:18.1634+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(1) as cnt from __all_virtual_trans_stat where part_trans_action > 2 and ctx_create_time < date_sub(now(), interval 600 second) and svr_ip = ? and svr_port = ? 2023-07-21T16:52:18.26196+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T16:52:18.27215+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:18.27377+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.008076349, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:18.27572+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=24.65 2023-07-21T16:52:18.27643+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.09 2023-07-21T16:52:18.84224+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:18.8426+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.243686273, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:18.32755+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.055785731, err="couldn't get SNTP reply: read udp 127.0.0.1:44560->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:18.61794+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) QUERY_TIMEOUT(100000000) */ count(*) as cnt from gv$table where table_type in (5) and index_status in (5, 6) 2023-07-21T16:52:18.84281+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:18.27735+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=32.31 2023-07-21T16:52:19.2657+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.953630833, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:18.85618+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:19.25636+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:18.7154+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:19.30473+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.249181492, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T16:52:19.28164+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.88220313, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:19.28144+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:19.3745+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:19.15481+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:19.28067+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T16:52:19.31657+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:20.62087+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.048331612, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:20.78454+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:20.68059+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T16:52:20.68036+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T16:52:20.98588+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:20.99248+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.077833837, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:20.99289+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:20.99388+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:20.98082+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:21.19655+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:21.19915+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:21.20028+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:21.20064+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:21.45219+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:21.57919+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.194988665, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:21.44819+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:22.0122+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T16:52:21.6593+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.201031129, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:22.08322+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:22.08641+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu4, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:22.0876+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:22.09261+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu5, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:22.09408+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu5, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:15.88906+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) QUERY_TIMEOUT(100000000) */ count(*) as cnt from gv$table where table_type in (5) and index_status in (5, 6) 2023-07-21T16:52:22.40982+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000891313, err="couldn't get SNTP reply: read udp 127.0.0.1:60676->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:22.09458+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T16:52:22.43307+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu6, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:22.43466+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu6, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:22.43597+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu7, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:22.43675+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu7, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:22.43801+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu8, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:22.44397+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu8, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:22.44551+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu9, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:22.44668+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu9, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:22.54226+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:22.54239+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.28030053, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:22.57401+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.310913693, err="couldn't get SNTP reply: read udp 127.0.0.1:43011->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:22.54263+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:22.43337+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:22.46254+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:22.55102+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:22.91069+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:22.9622+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:22.9624+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:22.9637+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:22.97132+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:22.97191+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T16:52:22.05363+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000477107, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:22.55803+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T16:52:22.81171+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:22.98363+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.428525891, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:22.98148+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=28.6 2023-07-21T16:52:22.98681+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.78 2023-07-21T16:52:22.98766+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=32.53 2023-07-21T16:52:22.98503+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:22.99248+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:22.99531+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:22.99998+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:23.00121+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:23.00061+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.737263565, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:23.00835+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00874126, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:22.99255+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=28.6 2023-07-21T16:52:22.55382+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(1) as cnt from __all_virtual_trans_stat where part_trans_action > 2 and ctx_create_time < date_sub(now(), interval 600 second) and svr_ip = ? and svr_port = ? 2023-07-21T16:52:22.99074+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.416810727, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:22.55836+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:22.97726+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:23.01947+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:22.98063+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:22.97625+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:23.03065+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=28.6 2023-07-21T16:52:23.79322+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:23.79739+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:23.22778+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.26775+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T16:52:23.79319+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:23.60523+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T16:52:24.27852+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:23.79565+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) QUERY_TIMEOUT(100000000) */ count(*) as cnt from gv$table where table_type in (5) and index_status in (5, 6) 2023-07-21T16:52:24.27608+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T16:52:24.26789+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:24.60497+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:24.13785+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:24.28636+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:23.79517+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:24.615+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:24.61491+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:24.61706+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.004526858, err="couldn't get SNTP reply: read udp 127.0.0.1:38091->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:24.61919+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:24.61965+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:23.60694+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001865636, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:24.62074+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:24.26758+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:23.49326+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=28.6 2023-07-21T16:52:24.62299+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.62572+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:24.62086+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.62655+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:24.26732+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:24.6272+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.78 2023-07-21T16:52:24.63559+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.63673+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.63528+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:24.29319+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=0, fields.level=debug, fields.msg="CPU Idle counter jumped backwards more than 3.000000 seconds, possible hotplug event, resetting CPU stats", new_value=73465.49, old_value=73468.82 2023-07-21T16:52:24.64894+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=1, fields.level=debug, fields.msg="CPU Idle counter jumped backwards more than 3.000000 seconds, possible hotplug event, resetting CPU stats", new_value=74154.97, old_value=74158.89 2023-07-21T16:52:24.64969+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.64969+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.28222+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) QUERY_TIMEOUT(100000000) */ count(*) as cnt from gv$table where table_type in (5) and index_status in (5, 6) 2023-07-21T16:52:24.28573+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:52:24.63621+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=32.53 2023-07-21T16:52:24.65027+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=2, fields.level=debug, fields.msg="CPU Idle counter jumped backwards more than 3.000000 seconds, possible hotplug event, resetting CPU stats", new_value=74298.24, old_value=74302.08 2023-07-21T16:52:24.2653+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.61591+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.32454+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:24.61527+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.265240827, err="couldn't get SNTP reply: read udp 127.0.0.1:45958->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:24.63587+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.01260966, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:24.26251+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:24.60491+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:24.17505+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.78 2023-07-21T16:52:24.70794+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.214274169, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:24.62247+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:24.62261+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:24.63668+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.033102919, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:24.64908+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:24.60556+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.78 2023-07-21T16:52:19.47191+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.070114121, err="couldn't get SNTP reply: read udp 127.0.0.1:41839->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:24.63893+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:19.71595+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:19.75043+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T16:52:19.71621+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.385899321, err="couldn't get SNTP reply: read udp 127.0.0.1:49869->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:23.80676+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:24.61329+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:24.62259+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:24.64691+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=28.6 2023-07-21T16:52:24.64743+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.60524+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:24.64761+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.03547721, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:24.83883+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:24.64804+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=12.903132711, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:24.83808+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:25.19862+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:25.25479+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:25.3862+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:25.45376+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:25.97879+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:25.46695+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:27.41937+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:25.46686+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(1) as cnt from __all_virtual_trans_stat where part_trans_action > 2 and ctx_create_time < date_sub(now(), interval 600 second) and svr_ip = ? and svr_port = ? 2023-07-21T16:52:27.42592+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:25.65638+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:27.52133+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T16:52:26.84467+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T16:52:26.89949+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:27.41891+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:27.41375+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:27.35965+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:25.71794+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:27.52105+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:25.46955+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=24.65 2023-07-21T16:52:25.65703+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T16:52:25.71808+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:27.1357+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T16:52:27.41741+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:25.46696+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=32.53 2023-07-21T16:52:27.7065+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:27.71287+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:27.71475+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.78 2023-07-21T16:52:27.7173+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:27.77797+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:27.83409+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:27.90332+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:27.86913+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:27.90959+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=9.317589636, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:28.06044+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:28.05528+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:28.07109+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:28.07808+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:28.07969+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:28.0785+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:28.05668+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.943603307, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:27.90583+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:28.07479+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:28.07979+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.09 2023-07-21T16:52:28.08266+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:28.11237+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.429446968, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:28.08268+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:28.17194+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:28.18052+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:28.10747+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:28.18361+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=32.53 2023-07-21T16:52:28.60854+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:28.69778+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:29.04662+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:28.69673+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:29.04604+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:28.74889+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:28.7375+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:28.73732+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:29.04575+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:29.0454+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:28.50344+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:29.03289+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:29.04705+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:29.11739+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:29.19874+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:29.19053+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:29.11768+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.052639595, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:29.2696+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=32.31 2023-07-21T16:52:30.35761+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:19.31669+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:30.36287+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:30.36165+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.7014119149999996, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:30.42321+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:30.42298+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.684484022, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:30.48693+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=27.35 2023-07-21T16:52:30.4868+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.174848467, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:30.5425+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T16:52:30.92574+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:30.48949+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.219541156, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:30.94623+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) QUERY_TIMEOUT(100000000) */ count(*) as cnt from gv$table where table_type in (5) and index_status in (5, 6) 2023-07-21T16:52:30.54217+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:31.03761+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:30.94667+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:31.04107+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:31.04083+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:30.62591+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.250729655, err="couldn't get SNTP reply: read udp 127.0.0.1:35929->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:31.0417+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:31.04123+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:31.04501+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.006988118, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:31.05947+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:31.83151+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:31.91804+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=27.08 2023-07-21T16:52:31.91854+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:31.90871+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:31.92734+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.031887798, err="couldn't get SNTP reply: read udp 127.0.0.1:56479->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:31.9245+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:31.96873+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:31.96858+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=27.08 2023-07-21T16:52:31.90787+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.074020626, err="couldn't get SNTP reply: read udp 127.0.0.1:56623->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:32.03588+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:32.51604+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:35.24337+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:35.05973+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:35.92893+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:35.61658+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:36.01541+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:31.97306+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1226404864e+10 Active_bytes:3.2397635584e+10 Active_file_bytes:1.17123072e+09 AnonHugePages_bytes:2.9597106176e+10 AnonPages_bytes:3.1225581568e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.65525504e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6807254016e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:311296 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85638144e+08 Inactive_file_bytes:4.6833664e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26500864e+08 MemAvailable_bytes:1.7244975104e+10 MemFree_bytes:1.5921324032e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.704576e+07 SReclaimable_bytes:8.1063936e+07 SUnreclaim_bytes:1.17846016e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98909952e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:36.01574+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:36.01582+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:36.01595+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:36.02784+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:36.02792+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:36.12914+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:36.31274+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.336150272, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:36.44026+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:36.50748+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:36.01425+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:36.29598+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.76302628, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:36.53163+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:36.10415+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1232827392e+10 Active_bytes:3.2404058112e+10 Active_file_bytes:1.17123072e+09 AnonHugePages_bytes:2.9597106176e+10 AnonPages_bytes:3.1228678144e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.65525504e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.680882688e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:311296 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85638144e+08 Inactive_file_bytes:4.6833664e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26500864e+08 MemAvailable_bytes:1.7239171072e+10 MemFree_bytes:1.591552e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.704576e+07 SReclaimable_bytes:8.1063936e+07 SUnreclaim_bytes:1.17846016e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98909952e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:36.0146+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:36.53979+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:36.53388+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:36.53963+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:36.53998+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:36.54017+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=27.08 2023-07-21T16:52:36.5404+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.099742228, err="couldn't get SNTP reply: read udp 127.0.0.1:36685->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:36.54096+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.2132306, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:36.55715+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:36.55791+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:36.55832+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.758822421, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:36.54076+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:36.5264+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:36.58641+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.267404724, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:36.58817+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.107860087, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:36.74648+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.624915999, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:36.76555+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:36.6454+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:36.79443+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.092014163, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:36.80281+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.1359256460000005, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:36.89434+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:37.15329+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:36.55923+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1248924672e+10 Active_bytes:3.2420159488e+10 Active_file_bytes:1.171234816e+09 AnonHugePages_bytes:2.9605494784e+10 AnonPages_bytes:3.1249248256e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655267328e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6815642624e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:323584 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.8564224e+08 Inactive_file_bytes:4.68340736e+08 KernelStack_bytes:2.4018944e+07 Mapped_bytes:1.26500864e+08 MemAvailable_bytes:1.7224040448e+10 MemFree_bytes:1.5900381184e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.7459456e+07 SReclaimable_bytes:8.1063936e+07 SUnreclaim_bytes:1.178624e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98926336e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:37.32097+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.303059178, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:36.89583+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:37.43223+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:37.46725+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.104370587, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:37.45847+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:37.48049+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:37.49302+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:37.48599+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.56 2023-07-21T16:52:37.47373+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.04043185, err="couldn't get SNTP reply: read udp 127.0.0.1:42633->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:37.58914+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:37.58983+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:40.11506+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:42.24258+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.508641879, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:43.23068+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:43.31338+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:43.31559+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:43.45997+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.128362144, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:42.24388+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:43.47024+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.227064543, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:43.48252+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=20.504660686, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:43.49227+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:43.6058+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.289724604, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:43.61761+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T16:52:43.59245+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:43.63878+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T16:52:43.6201+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:43.46605+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1401201664e+10 Active_bytes:3.2572653568e+10 Active_file_bytes:1.171451904e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.14027008e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655476224e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6889276416e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:466944 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85646336e+08 Inactive_file_bytes:4.68344832e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26529536e+08 MemAvailable_bytes:1.7065930752e+10 MemFree_bytes:1.5742038016e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9781888e+07 SReclaimable_bytes:8.1088512e+07 SUnreclaim_bytes:1.18083584e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99172096e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:43.74125+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.430460886, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:43.61921+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:43.61797+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.92 2023-07-21T16:52:43.44849+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:43.98644+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.769734178, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:44.23537+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:44.51332+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T16:52:43.31204+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:43.87996+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.56491018, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:44.30662+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1092432896e+10 Active_bytes:3.2263544832e+10 Active_file_bytes:1.171111936e+09 AnonHugePages_bytes:2.9584523264e+10 AnonPages_bytes:3.1091666944e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655115776e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.673432064e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:643072 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.8562176e+08 Inactive_file_bytes:4.68320256e+08 KernelStack_bytes:2.3986176e+07 Mapped_bytes:1.26042112e+08 MemAvailable_bytes:1.7382465536e+10 MemFree_bytes:1.6058966016e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5235328e+07 SReclaimable_bytes:8.1031168e+07 SUnreclaim_bytes:1.17690368e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98721536e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:43.90372+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:45.91329+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:45.91379+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:45.93337+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:45.93408+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:45.91454+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:45.93521+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:45.9023+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:45.91468+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=34.89 2023-07-21T16:52:45.95638+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:45.93645+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:45.91477+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:45.91435+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:46.08254+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=33.22 2023-07-21T16:52:46.09026+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:46.09479+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.875340991, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:46.08991+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.09703+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=23.530323896, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:46.09456+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.09499+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:45.91523+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.635892002, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:46.09867+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:46.09832+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.0835+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:52:46.10139+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:52:46.10214+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:52:46.09851+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.11009+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.794764285, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:52:46.09888+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:46.10152+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.09818+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:46.13306+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T16:52:46.14934+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.14051+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.14949+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:46.15106+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T16:52:46.15004+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:46.15216+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:46.15301+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T16:52:46.15263+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:46.15317+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:46.15106+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.15276+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.16153+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T16:52:46.15304+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:46.1615+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:46.17544+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:46.2822+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.056880948, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:46.22617+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.6117+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:24.6424+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:24.64397+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.039089958, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:24.63843+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.84202+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:52:46.30886+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=32.53 2023-07-21T16:52:24.88363+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=3, fields.level=debug, fields.msg="CPU Idle counter jumped backwards more than 3.000000 seconds, possible hotplug event, resetting CPU stats", new_value=74098.88, old_value=74102.68 2023-07-21T16:52:24.79104+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.89393+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:46.31972+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:24.97951+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.3935785689999998, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:46.27324+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:46.27737+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.98094+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=24.65 2023-07-21T16:52:25.00298+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:25.00565+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:25.00327+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:24.98072+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1054925824e+10 Active_bytes:3.2225927168e+10 Active_file_bytes:1.171001344e+09 AnonHugePages_bytes:2.9574037504e+10 AnonPages_bytes:3.1050694656e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655017472e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6713172992e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:544768 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85609472e+08 Inactive_file_bytes:4.68307968e+08 KernelStack_bytes:2.3969792e+07 Mapped_bytes:1.25906944e+08 MemAvailable_bytes:1.7420304384e+10 MemFree_bytes:1.6096927744e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4145792e+07 SReclaimable_bytes:8.1031168e+07 SUnreclaim_bytes:1.1757568e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98606848e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:25.00829+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:46.29198+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:46.49452+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.204188913, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:52:46.48043+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:46.49725+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.813831737, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:46.50194+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:46.54537+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:24.99431+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1061680128e+10 Active_bytes:3.2232730624e+10 Active_file_bytes:1.171050496e+09 AnonHugePages_bytes:2.958032896e+10 AnonPages_bytes:3.1060467712e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655046144e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6714745856e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:573440 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85617664e+08 Inactive_file_bytes:4.6831616e+08 KernelStack_bytes:2.3969792e+07 Mapped_bytes:1.25943808e+08 MemAvailable_bytes:1.7413234688e+10 MemFree_bytes:1.6089800704e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4354688e+07 SReclaimable_bytes:8.1031168e+07 SUnreclaim_bytes:1.17612544e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98643712e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:46.27994+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T16:52:46.59352+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.62707+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=23.652186392, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:46.59472+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:46.66078+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.59454+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:52:46.66229+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.66327+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:52:46.66462+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.6651+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.09 2023-07-21T16:52:46.66417+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:46.66412+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=4, fields.level=debug, fields.msg="CPU Idle counter jumped backwards more than 3.000000 seconds, possible hotplug event, resetting CPU stats", new_value=74551.83, old_value=74555.4 2023-07-21T16:52:46.66638+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.67176+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=28.390408494, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:46.67232+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:46.69874+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:46.66692+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.71041+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:46.72887+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.959553331, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:46.73002+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.72482+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:46.72881+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T16:52:46.7242+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:46.73172+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:46.72791+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=25.336100601, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:46.72917+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=28.140662372, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:46.74159+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.74256+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.129812992e+10 Active_bytes:3.2469430272e+10 Active_file_bytes:1.171300352e+09 AnonHugePages_bytes:2.9624369152e+10 AnonPages_bytes:3.129853952e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655320576e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6847099904e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:368640 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.8564224e+08 Inactive_file_bytes:4.68340736e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26500864e+08 MemAvailable_bytes:1.7169154048e+10 MemFree_bytes:1.5845429248e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.7774848e+07 SReclaimable_bytes:8.1063936e+07 SUnreclaim_bytes:1.17932032e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98995968e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:46.76377+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T16:52:46.74421+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=24.309665169, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:46.74372+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=28.033543609, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:46.76919+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=18.591279841, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:46.77426+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=32.31 2023-07-21T16:52:46.77042+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.79804+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=5, fields.level=debug, fields.msg="CPU Idle counter jumped backwards more than 3.000000 seconds, possible hotplug event, resetting CPU stats", new_value=74945.91, old_value=74949.4 2023-07-21T16:52:46.76978+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=22.163936052, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:46.76405+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:52:46.80161+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:46.80155+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.80246+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:46.80143+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:46.94193+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:46.92289+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:46.76462+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:46.95348+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T16:52:46.96987+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:30.36317+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:46.7683+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:46.9694+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:46.76473+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.851120231, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:52:30.42219+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:47.02644+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:47.02756+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:47.02775+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T16:52:31.06815+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:31.09491+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T16:52:31.06846+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.7088772159999999, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:31.09461+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1197261824e+10 Active_bytes:3.2368484352e+10 Active_file_bytes:1.171222528e+09 AnonHugePages_bytes:2.9595009024e+10 AnonPages_bytes:3.1197171712e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655246848e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6795195392e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:303104 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85634048e+08 Inactive_file_bytes:4.68332544e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26492672e+08 MemAvailable_bytes:1.7276174336e+10 MemFree_bytes:1.5952535552e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.682048e+07 SReclaimable_bytes:8.1063936e+07 SUnreclaim_bytes:1.17833728e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98897664e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:31.19831+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:31.2572+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:52:31.29961+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=8.267866425, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:52:31.29932+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:31.3633+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:31.45253+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:31.54836+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:31.55719+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:31.64182+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:31.39981+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1213498368e+10 Active_bytes:3.2384729088e+10 Active_file_bytes:1.17123072e+09 AnonHugePages_bytes:2.9597106176e+10 AnonPages_bytes:3.1214063616e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.65525504e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6799913984e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:311296 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85638144e+08 Inactive_file_bytes:4.6833664e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26500864e+08 MemAvailable_bytes:1.7259864064e+10 MemFree_bytes:1.5936212992e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.704576e+07 SReclaimable_bytes:8.1063936e+07 SUnreclaim_bytes:1.17846016e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98909952e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:31.62894+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000800509, err="couldn't get SNTP reply: read udp 127.0.0.1:35650->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:31.33194+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:31.45221+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:31.32806+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:31.72632+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:31.73021+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=27.35 2023-07-21T16:52:39.61978+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.086346424, err="couldn't get SNTP reply: read udp 127.0.0.1:55331->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:31.72758+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:47.04945+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.52063409, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:47.05197+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:47.05268+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.256856569, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:47.05381+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=6, fields.level=debug, fields.msg="CPU Idle counter jumped backwards more than 3.000000 seconds, possible hotplug event, resetting CPU stats", new_value=75149.53, old_value=75153.08 2023-07-21T16:52:31.58653+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:47.06491+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:47.05501+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:52:39.62589+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.512968212, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:47.05163+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.696547401, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:47.07191+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:47.07578+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:31.58793+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:47.05974+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=32.756431522, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:52:47.07832+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.723306486, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:47.07769+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.486246566, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:47.09091+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:47.09629+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:52:47.09031+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=15.034743638, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:47.08927+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:47.12192+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=14.440405993, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:47.11138+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:47.19124+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:47.17178+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.57 2023-07-21T16:52:47.68458+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:47.72093+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.353667014, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:47.72097+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=24.874837457, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:47.77358+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:47.77367+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:47.77708+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:47.78378+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.57 2023-07-21T16:52:47.90136+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.172780998, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:47.92025+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.111292323, err="couldn't get SNTP reply: read udp 127.0.0.1:34945->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:47.95713+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:47.94934+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=7.613659236, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:47.97234+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.275698993, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:47.9726+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.8930425, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:47.77688+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:47.92182+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:47.99641+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.46 2023-07-21T16:52:47.99495+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:48.05452+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.295549644, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:47.99668+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.237686215, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:47.94494+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.238921445, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:47.96135+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.146637312e+10 Active_bytes:3.2637943808e+10 Active_file_bytes:1.171570688e+09 AnonHugePages_bytes:2.9618077696e+10 AnonPages_bytes:3.1468060672e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655599104e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6932595712e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:446464 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85646336e+08 Inactive_file_bytes:4.68344832e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26570496e+08 MemAvailable_bytes:1.7000026112e+10 MemFree_bytes:1.5676014592e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0703488e+07 SReclaimable_bytes:8.1092608e+07 SUnreclaim_bytes:1.18104064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99196672e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:48.11+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:48.1111+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=34.69 2023-07-21T16:52:48.17508+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:48.17596+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=24.685104575, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:52:48.20895+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=32.43 2023-07-21T16:52:48.24132+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.46477948, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:48.2424+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=16.512678352000002, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:48.20839+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:48.17426+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=34.69 2023-07-21T16:52:48.24057+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=33.16 2023-07-21T16:52:48.20083+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:48.24152+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:48.2577+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:48.25815+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:48.2587+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:48.25944+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:48.25995+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.576206134, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:52:48.26181+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:48.25616+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.084556703, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:48.24136+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00049992, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:48.26273+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:48.26899+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:48.25613+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=33.16 2023-07-21T16:52:48.2564+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:48.27021+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:48.26985+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.493660557, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:48.27083+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:48.27236+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000658731, err="couldn't get SNTP reply: read udp 127.0.0.1:34643->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:48.27134+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:48.27392+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.57 2023-07-21T16:52:48.27484+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:48.26961+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:48.31251+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:52:48.3135+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:52:48.31258+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=34.69 2023-07-21T16:52:48.3146+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=33.16 2023-07-21T16:52:48.31541+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.041833868, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:48.31431+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:52:48.31859+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T16:52:48.31946+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T16:52:48.32465+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T16:52:48.32551+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T16:52:48.32635+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T16:52:48.32721+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T16:52:48.32765+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T16:52:48.32508+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:48.32875+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:52:48.32947+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:52:48.33213+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:52:48.33294+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T16:52:48.32825+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T16:52:48.33478+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T16:52:48.33496+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T16:52:48.33552+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T16:52:48.32582+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1478992896e+10 Active_bytes:3.2650563584e+10 Active_file_bytes:1.171570688e+09 AnonHugePages_bytes:2.9618077696e+10 AnonPages_bytes:3.148087296e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655599104e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6942721024e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:446464 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85646336e+08 Inactive_file_bytes:4.68344832e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26570496e+08 MemAvailable_bytes:1.6987250688e+10 MemFree_bytes:1.5663239168e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0703488e+07 SReclaimable_bytes:8.1092608e+07 SUnreclaim_bytes:1.18104064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99196672e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:48.33718+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T16:52:48.7726+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T16:52:48.81764+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:48.83369+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T16:52:48.83366+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T16:52:48.88974+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:48.91915+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T16:52:48.92027+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T16:52:48.92039+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.644872357, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:48.92286+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T16:52:48.92108+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T16:52:48.92357+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T16:52:48.92489+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T16:52:48.92568+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T16:52:48.92629+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T16:52:48.92672+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000792723, err="couldn't get SNTP reply: read udp 127.0.0.1:48777->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:48.9293+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.57 2023-07-21T16:52:48.94468+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=34.69 2023-07-21T16:52:48.91888+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:48.90949+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:48.97621+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T16:52:48.97414+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:48.98542+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:49.10123+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:49.1024+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1481831424e+10 Active_bytes:3.2653430784e+10 Active_file_bytes:1.17159936e+09 AnonHugePages_bytes:2.9618077696e+10 AnonPages_bytes:3.1482609664e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655635968e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6947439616e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:483328 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85654528e+08 Inactive_file_bytes:4.68353024e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26582784e+08 MemAvailable_bytes:1.698377728e+10 MemFree_bytes:1.5659720704e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0846848e+07 SReclaimable_bytes:8.1104896e+07 SUnreclaim_bytes:1.18104064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.9920896e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:49.10197+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:47.47336+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.124403538, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:49.13729+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:49.13756+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:49.1391+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T16:52:48.98519+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=33.16 2023-07-21T16:52:49.13873+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.016267504, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:49.18281+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.166967413, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:49.1826+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T16:52:49.32582+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T16:52:49.35945+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.253389165, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:49.36298+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:49.36386+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:49.36455+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:49.36529+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:49.36576+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.420861973, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:52:49.45547+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:49.46194+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.505421521, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:49.61374+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.210819466, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:47.4136+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:52:49.74561+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:47.13517+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.247192996, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:47.19442+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.865399437, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:49.68074+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:49.79458+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:49.79356+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.011080618, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:49.68086+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:49.88793+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.017322811, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:49.74691+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:50.03346+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:50.03428+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:49.85291+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:50.10247+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1508082688e+10 Active_bytes:3.2679702528e+10 Active_file_bytes:1.17161984e+09 AnonHugePages_bytes:2.9618077696e+10 AnonPages_bytes:3.150454784e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655652352e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6969459712e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:499712 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85654528e+08 Inactive_file_bytes:4.68353024e+08 KernelStack_bytes:2.4018944e+07 Mapped_bytes:1.26590976e+08 MemAvailable_bytes:1.695821824e+10 MemFree_bytes:1.5634141184e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.1113088e+07 SReclaimable_bytes:8.1104896e+07 SUnreclaim_bytes:1.1814912e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99254016e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:49.96993+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:50.29649+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:50.29866+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:50.06307+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:50.39836+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:50.40499+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:50.40743+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:50.40831+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:50.30298+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:47.12532+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:50.43948+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:47.45694+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.281839899, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:49.80683+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:49.74631+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:52:50.03703+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:50.52496+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:50.61252+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:47.50893+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:50.533+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:50.60133+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:50.43617+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000542661, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:50.88381+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:49.98115+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.299185884, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:50.28836+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:50.00203+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.418650585, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:50.00355+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.388007156, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:49.85532+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.57 2023-07-21T16:52:49.98419+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.63367173, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T16:52:49.85444+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:50.00295+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.104667856, err="couldn't get SNTP reply: read udp 127.0.0.1:43513->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:49.98117+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.149293662, err="couldn't get SNTP reply: read udp 127.0.0.1:48800->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:50.16524+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:50.00164+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:50.26656+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:49.97153+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.57 2023-07-21T16:52:49.87028+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.094473088, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T16:52:50.16494+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:50.21276+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.311856722, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:49.9875+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.146554515, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:50.50704+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:50.48186+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:50.43713+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.13463541, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:50.88429+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:50.48269+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.020445968, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:50.26654+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:50.88589+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:51.11281+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:50.8861+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:49.85381+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:49.9874+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1413891072e+10 Active_bytes:3.2585367552e+10 Active_file_bytes:1.17147648e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1413817344e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.6555008e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6897828864e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:491520 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85646336e+08 Inactive_file_bytes:4.68344832e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26541824e+08 MemAvailable_bytes:1.7052438528e+10 MemFree_bytes:1.5728521216e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0269312e+07 SReclaimable_bytes:8.1092608e+07 SUnreclaim_bytes:1.18104064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99196672e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:50.50172+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:51.11337+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:51.11973+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:50.17264+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1506038784e+10 Active_bytes:3.2677658624e+10 Active_file_bytes:1.17161984e+09 AnonHugePages_bytes:2.9618077696e+10 AnonPages_bytes:3.1506219008e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655652352e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6964216832e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:499712 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85654528e+08 Inactive_file_bytes:4.68353024e+08 KernelStack_bytes:2.4018944e+07 Mapped_bytes:1.26590976e+08 MemAvailable_bytes:1.6959561728e+10 MemFree_bytes:1.5635484672e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.1113088e+07 SReclaimable_bytes:8.1104896e+07 SUnreclaim_bytes:1.1814912e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99254016e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:51.11823+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T16:52:51.18185+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.013955436, err="couldn't get SNTP reply: read udp 127.0.0.1:51908->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:51.18993+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.167034212, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:51.18976+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.57 2023-07-21T16:52:51.36428+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:51.81784+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.087700492, err="couldn't get SNTP reply: read udp 127.0.0.1:41742->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:51.5176+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:51.55918+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:52.00865+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:51.16737+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:52.0181+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.419557457, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:51.44677+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:52.01838+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:52.49604+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:52.57846+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:52.25514+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:52.57703+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:52.82609+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:52.82621+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:52.82668+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=40.44 2023-07-21T16:52:52.82756+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:52.82969+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:52.92367+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.474822274, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:52.95433+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.457093841, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:53.64165+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:53.64365+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=34.69 2023-07-21T16:52:54.18254+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:54.13388+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.641369498, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:54.24219+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:54.24255+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:54.37084+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:54.36784+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=34.69 2023-07-21T16:52:54.20197+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:54.37518+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:54.37278+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:54.44228+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:54.44802+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:56.29882+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:56.6114+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.925096222, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:54.5569+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:56.59316+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:57.00197+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:57.00178+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:57.01241+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:57.08772+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=34.69 2023-07-21T16:52:57.08139+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:56.984+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:57.0804+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T16:52:57.08809+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=13.755179147, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:57.11006+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:57.16023+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:57.15996+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:57.16239+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:57.16095+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.996446146, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:57.17608+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:57.20939+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=35.15 2023-07-21T16:52:57.2002+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:57.22499+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:57.20931+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:57.20793+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:57.29597+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:57.29707+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:57.22107+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:57.29982+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=33.16 2023-07-21T16:52:57.31667+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:57.30677+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:57.32653+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:57.32939+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=33.16 2023-07-21T16:52:57.35644+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:57.31716+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:57.32984+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:57.35898+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:57.36399+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:57.36278+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:57.37323+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=33.16 2023-07-21T16:52:57.37403+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T16:52:57.36424+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:57.37519+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:57.37467+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:57.37391+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:57.37371+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:57.3766+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:57.39195+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:57.39032+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:57.41244+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:57.3905+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=33.32 2023-07-21T16:52:57.42098+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:57.4208+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=7.565694809, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:57.42182+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:57.42344+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=7.454110647, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:57.53366+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:57.63216+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:57.5166+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:57.53406+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:57.53325+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:57.73467+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=7.021329744, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:57.73564+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:57.75332+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=8.728999533, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:52:57.82874+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:57.73524+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T16:52:57.79007+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:58.15055+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:57.82932+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:58.17008+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.117437125, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:58.20087+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:58.20144+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:58.33985+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:58.43229+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:57.83134+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:58.441+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:58.53714+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:58.46206+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:58.57758+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:58.59439+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:58.57694+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T16:52:58.44124+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:58.5959+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:58.58933+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:58.59915+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:58.6022+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:58.53774+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:58.59508+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:52:58.60151+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:58.57924+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:52:58.60369+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:58.60264+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T16:52:58.59469+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:58.60625+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:52:58.60792+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:58.60652+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:58.60923+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:58.60985+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:52:58.61042+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:52:58.61194+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:58.61093+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:52:58.6128+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:52:59.16554+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=8.753420268, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:52:59.14737+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:37.72145+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:59.2412+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:59.25872+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:40.28448+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=28.713872575, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:59.25874+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:59.45339+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:59.23999+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:59.18168+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T16:52:59.26486+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:59.45595+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:59.45604+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:59.49224+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:59.51029+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:59.65022+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1558262784e+10 Active_bytes:3.2730017792e+10 Active_file_bytes:1.171755008e+09 AnonHugePages_bytes:2.9620174848e+10 AnonPages_bytes:3.1556276224e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655791616e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.700979712e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:258048 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85654528e+08 Inactive_file_bytes:4.68353024e+08 KernelStack_bytes:2.4018944e+07 Mapped_bytes:1.26611456e+08 MemAvailable_bytes:1.6906514432e+10 MemFree_bytes:1.5582298112e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.226816e+07 SReclaimable_bytes:8.1117184e+07 SUnreclaim_bytes:1.18247424e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99364608e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:59.6998+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:59.27249+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1554818048e+10 Active_bytes:3.2726573056e+10 Active_file_bytes:1.171755008e+09 AnonHugePages_bytes:2.9620174848e+10 AnonPages_bytes:3.1555407872e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655791616e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7005078528e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:258048 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85654528e+08 Inactive_file_bytes:4.68353024e+08 KernelStack_bytes:2.4018944e+07 Mapped_bytes:1.26611456e+08 MemAvailable_bytes:1.6909361152e+10 MemFree_bytes:1.5585144832e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.226816e+07 SReclaimable_bytes:8.1117184e+07 SUnreclaim_bytes:1.18247424e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99364608e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:59.72262+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:00.40136+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:00.5601+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:00.56527+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:00.57348+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:00.57+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.369613535, err="couldn't get SNTP reply: read udp 127.0.0.1:34289->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:00.97293+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=40.41 2023-07-21T16:53:00.57955+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.007799467, err="couldn't get SNTP reply: read udp 127.0.0.1:50613->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:01.545+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:00.58813+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=40.41 2023-07-21T16:53:01.54582+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:01.6837+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T16:53:01.93933+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:01.93801+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002553188, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:01.80654+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:01.68406+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:53:01.94001+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:01.94013+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:01.94019+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:01.94039+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.776035228, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:53:01.79798+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=17.810936659, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:01.94132+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:53:01.94266+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:53:01.94139+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=40.41 2023-07-21T16:53:01.94679+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:01.94345+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.316581168, err="couldn't get SNTP reply: read udp 127.0.0.1:44564->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:01.72968+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=40.41 2023-07-21T16:53:01.94679+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=12.090533329, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T16:53:01.94751+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.334595566, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:01.94905+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:53:01.95194+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.267312702, err="couldn't get SNTP reply: read udp 127.0.0.1:45870->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:01.94952+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.694249592, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:01.95249+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.224965389, err="couldn't get SNTP reply: read udp 127.0.0.1:47285->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:01.72714+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T16:53:02.43569+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T16:53:02.43514+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:02.571+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:53:02.71361+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:02.71431+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.269490176, err="couldn't get SNTP reply: read udp 127.0.0.1:50223->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:01.95304+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:02.87709+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:00.04588+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:02.87791+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:03.03889+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:53:03.14476+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:02.9052+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=18.095508164, err="couldn't get SNTP reply: read udp 127.0.0.1:37870->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:37.87876+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:53:03.22592+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.791510596, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:03.21888+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:02.6775+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:03.22443+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1584149504e+10 Active_bytes:3.2755982336e+10 Active_file_bytes:1.171832832e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1583952896e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.65586944e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7026050048e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:335872 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85658624e+08 Inactive_file_bytes:4.6835712e+08 KernelStack_bytes:2.400256e+07 Mapped_bytes:1.26615552e+08 MemAvailable_bytes:1.688107008e+10 MemFree_bytes:1.555677184e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2870272e+07 SReclaimable_bytes:8.1117184e+07 SUnreclaim_bytes:1.1829248e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99409664e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:03.22813+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1601860608e+10 Active_bytes:3.2773705728e+10 Active_file_bytes:1.17184512e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1602548736e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655885824e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7034602496e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:352256 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85658624e+08 Inactive_file_bytes:4.6835712e+08 KernelStack_bytes:2.400256e+07 Mapped_bytes:1.26615552e+08 MemAvailable_bytes:1.6864374784e+10 MemFree_bytes:1.5540064256e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.3091456e+07 SReclaimable_bytes:8.1117184e+07 SUnreclaim_bytes:1.18300672e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99417856e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:37.85192+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:37.72232+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:03.24193+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T16:53:03.3691+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T16:53:03.4228+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:53:04.4898+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T16:53:04.48808+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.395383712, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:38.04862+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:04.49342+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T16:53:04.48739+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.934539712, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:38.13492+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:38.11658+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:04.67108+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.921729899, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:37.95292+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:04.93934+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:04.73802+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:04.93651+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:05.24727+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=57.91 2023-07-21T16:53:05.32986+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1589576704e+10 Active_bytes:3.2761409536e+10 Active_file_bytes:1.171832832e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1590948864e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.65586944e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7029720064e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:335872 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85658624e+08 Inactive_file_bytes:4.6835712e+08 KernelStack_bytes:2.400256e+07 Mapped_bytes:1.26615552e+08 MemAvailable_bytes:1.6875978752e+10 MemFree_bytes:1.5551680512e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2870272e+07 SReclaimable_bytes:8.1117184e+07 SUnreclaim_bytes:1.1829248e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99409664e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:05.33004+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:04.88487+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:05.24503+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1598501888e+10 Active_bytes:3.2770347008e+10 Active_file_bytes:1.17184512e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.15992064e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655885824e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.703339008e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:352256 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85658624e+08 Inactive_file_bytes:4.6835712e+08 KernelStack_bytes:2.400256e+07 Mapped_bytes:1.26615552e+08 MemAvailable_bytes:1.686704128e+10 MemFree_bytes:1.5542730752e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.3091456e+07 SReclaimable_bytes:8.1117184e+07 SUnreclaim_bytes:1.18300672e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99417856e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:05.61036+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:05.31959+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000831047, err="couldn't get SNTP reply: read udp 127.0.0.1:38214->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:04.67078+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:38.29062+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.56 2023-07-21T16:53:05.29399+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:05.3593+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:38.29051+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:05.88417+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:05.8853+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.862479713, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:05.92206+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.156342042, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:05.81931+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=57.91 2023-07-21T16:53:05.45923+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.112363671, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:38.17458+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:05.87628+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1616905216e+10 Active_bytes:3.2788770816e+10 Active_file_bytes:1.1718656e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1616876544e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655914496e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.70510848e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:368640 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85666816e+08 Inactive_file_bytes:4.68365312e+08 KernelStack_bytes:2.3986176e+07 Mapped_bytes:1.26615552e+08 MemAvailable_bytes:1.6849043456e+10 MemFree_bytes:1.5524704256e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.3369984e+07 SReclaimable_bytes:8.1117184e+07 SUnreclaim_bytes:1.1831296e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99430144e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:07.60226+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:53:07.65624+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:38.29094+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:38.67969+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1328034816e+10 Active_bytes:3.2499388416e+10 Active_file_bytes:1.1713536e+09 AnonHugePages_bytes:2.9624369152e+10 AnonPages_bytes:3.1328129024e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.65537792e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6854509568e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:430080 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.8564224e+08 Inactive_file_bytes:4.68340736e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26500864e+08 MemAvailable_bytes:1.7139408896e+10 MemFree_bytes:1.5815630848e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.8012416e+07 SReclaimable_bytes:8.1068032e+07 SUnreclaim_bytes:1.17940224e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99008256e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:40.2967+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:38.67984+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:38.86658+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.469752471, err="couldn't get SNTP reply: read udp 127.0.0.1:44439->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:38.80239+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:40.29773+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:38.88571+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:39.09896+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:38.88686+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.003791074, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:08.57072+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T16:53:08.57171+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:40.31384+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:08.57098+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:08.64138+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:40.31287+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=17.32755552, err="couldn't get SNTP reply: read udp 127.0.0.1:41159->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:40.31713+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:08.57933+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:08.64671+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:08.68266+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:08.6829+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:08.74382+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:08.85848+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.115390237, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:08.7432+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=9.706340855, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:53:12.81946+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:40.33797+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.32 2023-07-21T16:53:13.13447+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:13.13477+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:53:13.15428+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:13.15403+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=28.847888574, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:13.04975+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.202666725, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:13.15127+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:13.13522+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=78.14 2023-07-21T16:53:13.15129+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.051288004, err="couldn't get SNTP reply: read udp 127.0.0.1:57986->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:13.28399+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=28.991919956, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:13.19482+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:13.28374+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.377095905, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:13.78599+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:13.79199+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:13.77039+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:13.50077+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:53:13.78655+08:00 INFO [24352,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server 2023-07-21T16:53:13.8371+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:13.84854+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T16:53:13.84447+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=35.23 2023-07-21T16:53:13.80193+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:53:13.84885+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:13.7975+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:13.84146+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=29.326566601, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:13.8885+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=35.23 2023-07-21T16:53:13.89336+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:13.79704+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=29.489671367, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:13.90934+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=78.14 2023-07-21T16:53:13.9088+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=29.387999572, err="couldn't get SNTP reply: read udp 127.0.0.1:32927->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:13.89989+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:53:15.11164+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:15.12515+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T16:53:14.26238+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=29.492927898, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:15.16414+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.438550386, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:15.32006+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=13.707064033, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:53:13.137+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.165376512e+10 Active_bytes:3.282601984e+10 Active_file_bytes:1.17225472e+09 AnonHugePages_bytes:2.9630660608e+10 AnonPages_bytes:3.1654649856e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.656397824e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7075726336e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:757760 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85720064e+08 Inactive_file_bytes:4.6841856e+08 KernelStack_bytes:2.3969792e+07 Mapped_bytes:1.2670976e+08 MemAvailable_bytes:1.6805859328e+10 MemFree_bytes:1.5481069568e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.370176e+07 SReclaimable_bytes:8.1129472e+07 SUnreclaim_bytes:1.1839488e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99524352e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:15.31777+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:14.44549+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T16:53:15.31773+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:15.1247+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T16:53:15.59038+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:15.76659+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=13.192751565, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:53:15.90408+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.405167906, err="couldn't get SNTP reply: read udp 127.0.0.1:47517->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:14.9019+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001295, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:15.32849+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:15.77592+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=78.14 2023-07-21T16:53:15.97713+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:16.53695+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:16.19041+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:16.71707+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:15.33723+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:16.72145+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:16.71757+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T16:53:16.77053+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:15.33182+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1701245952e+10 Active_bytes:3.2874225664e+10 Active_file_bytes:1.172979712e+09 AnonHugePages_bytes:2.964324352e+10 AnonPages_bytes:3.1699918848e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.657061376e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7097263104e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:1.421312e+06 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:4.85687296e+08 Inactive_file_bytes:4.68381696e+08 KernelStack_bytes:2.3986176e+07 Mapped_bytes:1.26738432e+08 MemAvailable_bytes:1.6760877056e+10 MemFree_bytes:1.5435395072e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.402944e+07 SReclaimable_bytes:8.114176e+07 SUnreclaim_bytes:1.1839488e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.9953664e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:16.78658+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:16.76874+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1697764352e+10 Active_bytes:3.2874262528e+10 Active_file_bytes:1.176498176e+09 AnonHugePages_bytes:2.9628563456e+10 AnonPages_bytes:3.1697801216e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.660932096e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7081780224e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:5.292032e+06 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85793792e+08 Inactive_file_bytes:4.68492288e+08 KernelStack_bytes:2.3937024e+07 Mapped_bytes:1.26746624e+08 MemAvailable_bytes:1.676568576e+10 MemFree_bytes:1.5436546048e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.4123648e+07 SReclaimable_bytes:8.1199104e+07 SUnreclaim_bytes:1.18386688e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99585792e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:16.82442+08:00 INFO [24352,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T16:53:16.79174+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.43661468, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:17.40545+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:53:17.42328+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=36.137594178, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:17.50781+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.806232627, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:17.40998+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=52.814145061, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:17.50645+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=38.94 2023-07-21T16:53:16.84883+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:17.55758+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:53:17.46263+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:17.59909+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=15.403871182, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:53:17.76723+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T16:53:17.82905+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:17.84756+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=32.38 2023-07-21T16:53:17.86008+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:53:17.95758+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:53:17.98416+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:17.87668+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:53:12.32314+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:12.89949+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:17.87774+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=43.9 2023-07-21T16:53:17.98778+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:17.98852+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:53:17.98783+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:53:17.98702+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T16:53:17.99957+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=33.35 2023-07-21T16:53:17.99461+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:18.00119+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:39.06777+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.46 2023-07-21T16:53:17.98672+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=33.35 2023-07-21T16:53:17.99507+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:53:18.37256+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:53:19.16308+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T16:53:19.26274+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T16:53:19.51471+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T16:53:19.50208+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:19.25378+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=43.9 2023-07-21T16:53:19.65383+08:00 INFO [24352,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T16:53:19.80378+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=43.9 2023-07-21T16:53:19.80857+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:19.84322+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:40.35309+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001527947, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:40.35895+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:19.85013+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T16:53:19.85026+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:19.84948+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:19.67663+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:39.18183+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.311734996, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:19.80336+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:19.8498+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:19.23313+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(1) as cnt from __all_virtual_trans_stat where part_trans_action > 2 and ctx_create_time < date_sub(now(), interval 600 second) and svr_ip = ? and svr_port = ? 2023-07-21T16:53:19.67945+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:39.37498+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:39.23904+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:19.88533+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:40.36003+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.022360862, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:39.59461+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.56 2023-07-21T16:52:39.18074+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1339065344e+10 Active_bytes:3.2510418944e+10 Active_file_bytes:1.1713536e+09 AnonHugePages_bytes:2.9624369152e+10 AnonPages_bytes:3.1333142528e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.65537792e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.68618496e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:430080 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.8564224e+08 Inactive_file_bytes:4.68340736e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26500864e+08 MemAvailable_bytes:1.7131589632e+10 MemFree_bytes:1.5807811584e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.8012416e+07 SReclaimable_bytes:8.1068032e+07 SUnreclaim_bytes:1.17940224e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99008256e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:19.89329+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:19.89335+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=34.56 2023-07-21T16:52:40.3696+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:40.35306+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:40.37017+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:40.37694+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:53:19.90342+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:39.59698+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.575421873, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:40.35495+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.016980948, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:39.45249+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:39.18064+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.099478625, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:19.89263+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.759304478, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:39.59763+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.181838315, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:19.9998+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:39.61916+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:20.10789+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.100599869, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:20.02367+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:20.13979+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T16:52:39.70042+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:39.61903+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:20.12446+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.217657779, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:53:20.11069+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.090709277, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:20.00274+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.368095751, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:40.37938+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:40.37565+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:40.38221+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:40.3822+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:40.38722+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:40.38776+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:40.38929+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:40.38939+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.009369668, err="couldn't get SNTP reply: read udp 127.0.0.1:57180->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:40.38196+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:39.84248+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:21.85665+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00253421, err="couldn't get SNTP reply: read udp 127.0.0.1:37910->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:21.82442+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:40.39098+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.7020893670000001, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:40.39202+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:40.39682+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:39.99206+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:22.68535+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:39.99344+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:52:39.99332+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:40.13686+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:40.14084+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:40.18135+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=17.177235378, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:40.17908+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:40.17235+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.56 2023-07-21T16:52:40.20386+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1344254976e+10 Active_bytes:3.2515678208e+10 Active_file_bytes:1.171423232e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1346466816e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655447552e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6857131008e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:438272 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.8564224e+08 Inactive_file_bytes:4.68340736e+08 KernelStack_bytes:2.4018944e+07 Mapped_bytes:1.26517248e+08 MemAvailable_bytes:1.7124749312e+10 MemFree_bytes:1.5800901632e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.8467072e+07 SReclaimable_bytes:8.1068032e+07 SUnreclaim_bytes:1.17977088e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.9904512e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:40.2647+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=16.459732636, err="couldn't get SNTP reply: read udp 127.0.0.1:50901->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:40.26859+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:40.2647+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:40.38988+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.56 2023-07-21T16:52:40.26392+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:22.98045+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:52:22.98046+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T16:52:40.39916+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:22.68591+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:22.98052+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.725782167, fields.level=debug, fields.msg="collector succeeded", name=cpu 2023-07-21T16:52:40.39577+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:40.39937+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:40.89207+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=9.04163828, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:40.69061+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.27536348, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:22.69249+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=50.727237309, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:40.69064+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:22.98151+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000726499, err="couldn't get SNTP reply: read udp 127.0.0.1:54461->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:41.24117+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:41.25275+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:41.27885+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:41.27485+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:41.27916+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.56 2023-07-21T16:52:41.28332+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:41.28344+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:41.28372+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:22.69875+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.688616394, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:22.70795+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:40.57025+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:41.28419+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:41.2792+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:52:22.98052+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:41.29795+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002836391, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:41.31135+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.005485782, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:41.31295+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=9.382028142, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:41.31053+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:41.28501+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:41.31341+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:41.31479+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.031279559, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:41.31283+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000691488, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:41.31209+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001023405, err="couldn't get SNTP reply: read udp 127.0.0.1:32792->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:41.35334+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.56 2023-07-21T16:52:41.31733+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:41.29668+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=17.48852038, err="couldn't get SNTP reply: read udp 127.0.0.1:57442->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:41.37174+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:41.29586+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.138951168e+10 Active_bytes:3.25609472e+10 Active_file_bytes:1.17143552e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1391465472e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.65545984e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.688036352e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:450560 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.8564224e+08 Inactive_file_bytes:4.68340736e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26529536e+08 MemAvailable_bytes:1.7078124544e+10 MemFree_bytes:1.5754264576e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9220736e+07 SReclaimable_bytes:8.1068032e+07 SUnreclaim_bytes:1.18030336e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99098368e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:22.71533+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:53:22.88335+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:53:22.90808+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=36.22 2023-07-21T16:53:22.92898+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:22.93197+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:53:22.93849+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T16:53:22.94947+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:47.09868+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.721884144, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:47.0953+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T16:52:47.08918+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:23.06435+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T16:53:23.05924+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.40771502, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:53:22.93778+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.218882458, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:53:23.05844+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:47.08888+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:41.86063+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:41.8613+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:41.87977+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.32 2023-07-21T16:52:41.86093+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:47.09251+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:22.99881+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:47.09406+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T16:52:41.87864+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1396069376e+10 Active_bytes:3.2567508992e+10 Active_file_bytes:1.171439616e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1396909056e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655472128e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6885082112e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:462848 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85650432e+08 Inactive_file_bytes:4.68348928e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26529536e+08 MemAvailable_bytes:1.7071886336e+10 MemFree_bytes:1.5748001792e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.942144e+07 SReclaimable_bytes:8.1088512e+07 SUnreclaim_bytes:1.18063104e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99151616e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:47.19422+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:25.0654+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:25.00599+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:25.16114+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.052212746, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:47.20573+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T16:53:25.16272+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=33.57 2023-07-21T16:53:25.16161+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.088145159, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:47.5838+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.274956788, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:25.16239+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:53:25.20133+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1786631168e+10 Active_bytes:3.297857536e+10 Active_file_bytes:1.191944192e+09 AnonHugePages_bytes:2.9647437824e+10 AnonPages_bytes:3.1787487232e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.677070336e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.712989184e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:1.3950976e+07 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.865024e+08 Inactive_file_bytes:4.69200896e+08 KernelStack_bytes:2.37568e+07 Mapped_bytes:1.26799872e+08 MemAvailable_bytes:1.6675577856e+10 MemFree_bytes:1.5330062336e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.4791296e+07 SReclaimable_bytes:8.1641472e+07 SUnreclaim_bytes:1.18378496e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.00019968e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:47.21131+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.7583535, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:47.21086+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:25.00807+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:25.37436+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=20.425391071, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T16:52:47.28539+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:47.28356+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T16:52:47.30655+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=24.324462476, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:52:47.31107+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1456534528e+10 Active_bytes:3.2628064256e+10 Active_file_bytes:1.171529728e+09 AnonHugePages_bytes:2.9620174848e+10 AnonPages_bytes:3.1458615296e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655574528e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6925779968e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:405504 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85658624e+08 Inactive_file_bytes:4.6835712e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26562304e+08 MemAvailable_bytes:1.7009946624e+10 MemFree_bytes:1.5685963776e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0633856e+07 SReclaimable_bytes:8.1092608e+07 SUnreclaim_bytes:1.18112256e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99204864e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:47.30932+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:25.51663+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.514908504, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:52:47.3396+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.110375794, err="couldn't get SNTP reply: read udp 127.0.0.1:53408->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:25.51796+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=47.330616643, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:47.31078+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1418130432e+10 Active_bytes:3.2589606912e+10 Active_file_bytes:1.17147648e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1423156224e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.6555008e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6899926016e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:491520 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85646336e+08 Inactive_file_bytes:4.68344832e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26541824e+08 MemAvailable_bytes:1.7044140032e+10 MemFree_bytes:1.572022272e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0269312e+07 SReclaimable_bytes:8.1092608e+07 SUnreclaim_bytes:1.18104064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99196672e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:47.34864+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:47.34949+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=16.311607032, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:52:47.30616+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:47.29131+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.57 2023-07-21T16:52:47.31054+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000626694, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:47.34858+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1456907264e+10 Active_bytes:3.2628436992e+10 Active_file_bytes:1.171529728e+09 AnonHugePages_bytes:2.9620174848e+10 AnonPages_bytes:3.1458615296e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655574528e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6926304256e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:405504 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85658624e+08 Inactive_file_bytes:4.6835712e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26562304e+08 MemAvailable_bytes:1.7009565696e+10 MemFree_bytes:1.5685582848e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0633856e+07 SReclaimable_bytes:8.1092608e+07 SUnreclaim_bytes:1.18112256e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99204864e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:47.30026+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.075057477, err="couldn't get SNTP reply: read udp 127.0.0.1:38309->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:25.60584+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:25.03304+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:25.71378+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:25.60639+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:25.72957+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:25.82461+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:53:27.21546+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.282782167, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:29.22921+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:29.73318+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:29.74584+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:47.60109+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1412297728e+10 Active_bytes:3.258376192e+10 Active_file_bytes:1.171464192e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1413510144e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655492608e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6895731712e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:483328 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85650432e+08 Inactive_file_bytes:4.68348928e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26529536e+08 MemAvailable_bytes:1.705465856e+10 MemFree_bytes:1.573074944e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.001536e+07 SReclaimable_bytes:8.1092608e+07 SUnreclaim_bytes:1.18095872e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.9918848e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:29.80273+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:29.75438+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:48.01196+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:53:29.73198+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=92.02 2023-07-21T16:52:48.01253+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:29.32768+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:48.01235+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T16:52:48.01305+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=7, fields.level=debug, fields.msg="CPU Idle counter jumped backwards more than 3.000000 seconds, possible hotplug event, resetting CPU stats", new_value=75202.38, old_value=75206.01 2023-07-21T16:53:29.81588+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.82955388, err="couldn't get SNTP reply: read udp 127.0.0.1:38768->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:29.8224+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:48.04152+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:29.81834+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:29.85878+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:52:48.04989+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:29.85713+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:29.8598+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:29.86181+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:53:29.9092+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:30.00045+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:29.95947+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:30.05978+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:30.25688+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:30.26592+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1842824192e+10 Active_bytes:3.3042550784e+10 Active_file_bytes:1.199726592e+09 AnonHugePages_bytes:2.9649534976e+10 AnonPages_bytes:3.1832625152e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.684983808e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7118603264e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:2.1823488e+07 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7309696e+07 Inactive_bytes:4.86801408e+08 Inactive_file_bytes:4.69491712e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.26787584e+08 MemAvailable_bytes:1.6616435712e+10 MemFree_bytes:1.5262703616e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.5348352e+07 SReclaimable_bytes:8.1928192e+07 SUnreclaim_bytes:1.185792e+08 Shmem_bytes:1.7846272e+07 Slab_bytes:2.00507392e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:30.296+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:30.30666+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:30.00375+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:53:30.32704+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001320378, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:30.32005+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:32.00706+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T16:53:32.00825+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:31.883+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:32.0085+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:32.06106+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:32.06243+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:52.57688+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.151120384e+10 Active_bytes:3.2682840064e+10 Active_file_bytes:1.171636224e+09 AnonHugePages_bytes:2.9618077696e+10 AnonPages_bytes:3.1511339008e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655668736e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6971032576e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:520192 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85650432e+08 Inactive_file_bytes:4.68348928e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26599168e+08 MemAvailable_bytes:1.6954462208e+10 MemFree_bytes:1.5630372864e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.1424384e+07 SReclaimable_bytes:8.1108992e+07 SUnreclaim_bytes:1.18177792e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99286784e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:32.14238+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=32.38 2023-07-21T16:53:32.14385+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:32.14993+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:32.1585+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T16:53:32.15721+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:32.15981+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000741878, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:32.15679+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=44.647821659, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:32.15571+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:59.90726+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:59.92803+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:59.94206+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:00.1066+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.850171073, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:33.6417+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T16:52:59.90779+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T16:53:33.66961+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:00.14875+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.37212374, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:33.72328+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:00.25247+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000663776, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:00.31397+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.1480949169999999, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:33.78971+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:40.28474+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:33.79188+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.141117952e+10 Active_bytes:3.2582643712e+10 Active_file_bytes:1.171464192e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1413510144e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655492608e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6895731712e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:483328 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85650432e+08 Inactive_file_bytes:4.68348928e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26529536e+08 MemAvailable_bytes:1.7052561408e+10 MemFree_bytes:1.5728652288e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.001536e+07 SReclaimable_bytes:8.1092608e+07 SUnreclaim_bytes:1.18095872e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.9918848e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:33.83236+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:33.8947+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=44.500031135, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:33.95093+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.14086919, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:00.32907+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.094530279, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:00.35199+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:00.27232+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.006494086, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:33.95835+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1536746496e+10 Active_bytes:3.2708411392e+10 Active_file_bytes:1.171664896e+09 AnonHugePages_bytes:2.9618077696e+10 AnonPages_bytes:3.1532457984e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655701504e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6995477504e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:552960 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85654528e+08 Inactive_file_bytes:4.68353024e+08 KernelStack_bytes:2.4018944e+07 Mapped_bytes:1.26599168e+08 MemAvailable_bytes:1.692413952e+10 MemFree_bytes:1.5600013312e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.200192e+07 SReclaimable_bytes:8.1113088e+07 SUnreclaim_bytes:1.18226944e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99340032e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:33.96551+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:33.96982+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:33.978+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:33.73656+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:33.98316+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=34.69 2023-07-21T16:53:33.99331+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:24.47938+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:42.21318+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.304154414, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:02.29661+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.69061047, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:34.03122+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:34.01957+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=46.806939502, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:53:34.02939+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:34.02251+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:34.00817+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:34.12077+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:34.10598+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:34.13866+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.015948195, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:34.01989+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.026380378, err="couldn't get SNTP reply: read udp 127.0.0.1:42680->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:34.12082+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=86.97 2023-07-21T16:53:36.02405+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=86.97 2023-07-21T16:53:36.57401+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.215672054, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:36.74771+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:36.75194+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:36.7693+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:53:32.65+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:54:44.24822+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:54:43.64228+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:54:42.13322+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T16:53:39.12761+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:33.19967+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.050989352, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:36.98421+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:36.98474+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:36.98743+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:08.95973+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:08.8783+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:36.98493+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:08.99716+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:12.38969+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T16:53:08.983+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:02.17125+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:02.15465+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:40.33269+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:12.32365+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:52:40.32768+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.32 2023-07-21T16:53:12.38321+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T16:53:12.3836+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T16:53:12.39173+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T16:53:12.56517+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.581526427, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:12.51847+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:12.39099+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=13.778065195, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:53:12.39112+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:09.01468+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.016984649, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:40.33617+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:12.5179+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T16:53:12.39029+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:12.51862+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T16:53:02.19589+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:12.32368+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T16:53:09.00559+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:12.57342+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:12.81968+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.245197031, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:12.57275+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.678029945, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:12.89838+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=35.23 2023-07-21T16:53:12.81923+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:53:12.82015+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=35.23 2023-07-21T16:53:12.51762+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:12.56486+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T16:53:12.84317+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:12.81305+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:13.01702+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:53:12.89718+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:12.89674+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:12.89839+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:13.09821+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:13.09825+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:13.10298+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=28.812842881, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:13.0461+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:40.34185+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:12.90574+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:12.81903+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:12.89876+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:12.91349+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:12.89934+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:40.34856+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:37.04456+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T16:53:36.98919+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:40.34823+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:37.06005+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:37.044+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:37.06821+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:02.00857+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:02.02599+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:41.88547+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:41.88545+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00075593, err="couldn't get SNTP reply: read udp 127.0.0.1:40247->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:23.09854+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:41.88497+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:41.89629+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:23.25335+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T16:52:42.10416+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:42.10806+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T16:52:42.02917+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:42.10808+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:53:01.6901+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:42.10725+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.92 2023-07-21T16:52:42.24242+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:42.2084+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T16:52:42.11007+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:42.2091+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.107640248, err="couldn't get SNTP reply: read udp 127.0.0.1:54110->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:42.24268+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:52:42.1245+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1396442112e+10 Active_bytes:3.2567881728e+10 Active_file_bytes:1.171439616e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1396909056e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655472128e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6885082112e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:462848 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85650432e+08 Inactive_file_bytes:4.68348928e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26529536e+08 MemAvailable_bytes:1.7071505408e+10 MemFree_bytes:1.5747620864e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.942144e+07 SReclaimable_bytes:8.1088512e+07 SUnreclaim_bytes:1.18063104e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99151616e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:42.24394+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T16:52:42.21654+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:52:42.20947+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:23.47457+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=32.43 2023-07-21T16:52:42.24436+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:42.24264+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:55:27.18237+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:55:27.18599+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:54.24095+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:55:27.24688+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:23.39098+08:00 INFO [24352,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T16:55:27.19906+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:54.524+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:55:27.35553+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=166.029598291, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:55:27.24778+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:55:27.93693+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:54.88833+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:42.24268+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:37.08939+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:01.95723+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1587713024e+10 Active_bytes:3.2759545856e+10 Active_file_bytes:1.171832832e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.158872064e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.65586944e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7028671488e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:335872 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85658624e+08 Inactive_file_bytes:4.6835712e+08 KernelStack_bytes:2.400256e+07 Mapped_bytes:1.26615552e+08 MemAvailable_bytes:1.6878272512e+10 MemFree_bytes:1.5553974272e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2870272e+07 SReclaimable_bytes:8.1117184e+07 SUnreclaim_bytes:1.1829248e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99409664e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:42.257+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:52:42.2633+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:42.26576+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.656609809, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:42.27502+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:42.26195+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:02.15465+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:42.27476+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.91903382, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:23.48699+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=36.22 2023-07-21T16:52:42.5015+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:42.52194+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1121309696e+10 Active_bytes:3.2292438016e+10 Active_file_bytes:1.17112832e+09 AnonHugePages_bytes:2.9586620416e+10 AnonPages_bytes:3.1115546624e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655136256e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6771549184e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:663552 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85625856e+08 Inactive_file_bytes:4.68324352e+08 KernelStack_bytes:2.400256e+07 Mapped_bytes:1.2611584e+08 MemAvailable_bytes:1.7353560064e+10 MemFree_bytes:1.6030040064e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5579392e+07 SReclaimable_bytes:8.1031168e+07 SUnreclaim_bytes:1.1769856e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98729728e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:42.58484+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=22.00614549, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:36.98776+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:23.54701+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:37.19422+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.163834299, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:42.37813+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:02.29377+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.685127651, err="couldn't get SNTP reply: read udp 127.0.0.1:41814->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:52:42.27045+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.92 2023-07-21T16:52:42.58639+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:42.87538+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:53:37.12498+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=43.235908949, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:42.58459+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T16:52:42.95823+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.446778007, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:23.48661+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:52:42.8736+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:42.86435+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.92 2023-07-21T16:52:42.30729+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1098683392e+10 Active_bytes:3.2269795328e+10 Active_file_bytes:1.171111936e+09 AnonHugePages_bytes:2.9584523264e+10 AnonPages_bytes:3.1095631872e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655115776e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6757921792e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:643072 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.8562176e+08 Inactive_file_bytes:4.68320256e+08 KernelStack_bytes:2.3986176e+07 Mapped_bytes:1.26042112e+08 MemAvailable_bytes:1.7376354304e+10 MemFree_bytes:1.6052854784e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5235328e+07 SReclaimable_bytes:8.1031168e+07 SUnreclaim_bytes:1.17690368e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98721536e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:42.95538+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1111192576e+10 Active_bytes:3.2282320896e+10 Active_file_bytes:1.17112832e+09 AnonHugePages_bytes:2.9586620416e+10 AnonPages_bytes:3.1111090176e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655136256e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6761591808e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:663552 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85625856e+08 Inactive_file_bytes:4.68324352e+08 KernelStack_bytes:2.400256e+07 Mapped_bytes:1.2611584e+08 MemAvailable_bytes:1.7362173952e+10 MemFree_bytes:1.6038653952e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5579392e+07 SReclaimable_bytes:8.1031168e+07 SUnreclaim_bytes:1.1769856e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98729728e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:52:42.95947+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.10299648e+10 Active_bytes:3.2200966144e+10 Active_file_bytes:1.171001344e+09 AnonHugePages_bytes:2.9574037504e+10 AnonPages_bytes:3.1030509568e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.655017472e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6705492992e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:544768 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.85609472e+08 Inactive_file_bytes:4.68307968e+08 KernelStack_bytes:2.3969792e+07 Mapped_bytes:1.25906944e+08 MemAvailable_bytes:1.7445076992e+10 MemFree_bytes:1.6121700352e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4145792e+07 SReclaimable_bytes:8.1031168e+07 SUnreclaim_bytes:1.1757568e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.98606848e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:02.29521+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.000168812, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:52:42.96085+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.506256341, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:43.0971+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:43.09619+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:52:42.87565+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.082238826, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:23.55393+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:42.91505+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:52:42.90002+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T16:52:42.9532+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:52:43.01906+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:23.56578+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=36.22 2023-07-21T16:53:24.01667+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:24.00984+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=87.85 2023-07-21T16:53:24.43621+08:00 INFO [24352,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T16:53:24.35726+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:24.47582+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:23.69819+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.089675939, err="couldn't get SNTP reply: read udp 127.0.0.1:56836->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:23.69761+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T16:53:37.24318+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:24.56743+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:37.24366+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:54:13.37135+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:24.5681+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:24.63094+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:24.87193+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.8518031839999995, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:24.9099+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:24.81281+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=87.85 2023-07-21T16:53:24.8223+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:24.91428+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1782494208e+10 Active_bytes:3.2974065664e+10 Active_file_bytes:1.191571456e+09 AnonHugePages_bytes:2.9647437824e+10 AnonPages_bytes:3.1782469632e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.677070336e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.71272704e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:1.3950976e+07 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.865024e+08 Inactive_file_bytes:4.69200896e+08 KernelStack_bytes:2.37568e+07 Mapped_bytes:1.26799872e+08 MemAvailable_bytes:1.6680062976e+10 MemFree_bytes:1.5334920192e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.4791296e+07 SReclaimable_bytes:8.1641472e+07 SUnreclaim_bytes:1.18378496e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.00019968e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:24.93086+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:24.80846+08:00 INFO [24352,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server 2023-07-21T16:53:25.00229+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:25.00202+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:37.24464+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T16:53:24.95983+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:52:47.18089+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1382945792e+10 Active_bytes:3.2554381312e+10 Active_file_bytes:1.17143552e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.138248704e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.65545984e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6874596352e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:450560 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.8564224e+08 Inactive_file_bytes:4.68340736e+08 KernelStack_bytes:2.4035328e+07 Mapped_bytes:1.26529536e+08 MemAvailable_bytes:1.7085693952e+10 MemFree_bytes:1.5761833984e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9220736e+07 SReclaimable_bytes:8.1068032e+07 SUnreclaim_bytes:1.18030336e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:1.99098368e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:30.3451+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:30.35079+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:30.35614+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:30.35506+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=43.070497047, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:02.29872+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T16:53:30.45731+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.130005287, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:30.67371+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=66.967094687, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:30.75536+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.602301554, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:30.44722+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:02.23037+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=57.91 2023-07-21T16:53:30.91325+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:30.91043+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:38.86724+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:02.29765+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.902097172, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:38.87114+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002331359, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:38.87739+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:38.90604+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:38.90443+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:53:38.92129+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T16:54:38.00316+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:38.96672+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000922316, err="couldn't get SNTP reply: read udp 127.0.0.1:47402->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:38.96906+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:38.97006+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:39.00208+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.147069474, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:38.99725+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:39.00258+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:39.00243+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=36.036709205, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:38.99045+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000904268, err="couldn't get SNTP reply: read udp 127.0.0.1:35859->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:31.72183+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T16:53:38.96323+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T16:53:31.90042+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:31.88289+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T16:54:44.24423+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:54:44.59014+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:54:44.27539+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=48.68 2023-07-21T16:53:39.17293+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:39.23542+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:39.23679+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:39.17367+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:39.44959+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:39.44806+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=82.09 2023-07-21T16:53:13.9148+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:53:39.37058+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:13.92703+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=29.408392266, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:52:58.58123+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:39.58822+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:39.61208+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:57:25.02496+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:39.61234+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:13.93402+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:39.62533+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1964278784e+10 Active_bytes:3.3165320192e+10 Active_file_bytes:1.201041408e+09 AnonHugePages_bytes:2.9660020736e+10 AnonPages_bytes:3.1965638656e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.686245376e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7203775488e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:2.3097344e+07 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.86821888e+08 Inactive_file_bytes:4.69520384e+08 KernelStack_bytes:2.3642112e+07 Mapped_bytes:1.26865408e+08 MemAvailable_bytes:1.6491065344e+10 MemFree_bytes:1.5135973376e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.6638592e+07 SReclaimable_bytes:8.1956864e+07 SUnreclaim_bytes:1.1923456e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.01191424e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:14.29332+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:53:14.22847+08:00 INFO [24352,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server 2023-07-21T16:53:14.22227+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.330484697, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:34.90035+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:35.52845+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:35.39462+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.4036162509999999, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:35.80569+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:53:34.672+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.877655236, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:34.67269+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.838100555, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:35.52954+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:34.67666+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=47.38911692, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:53:35.81888+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=70.990700297, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:53:35.41144+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:14.36094+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:14.5331+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:35.82582+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1915778048e+10 Active_bytes:3.3116135424e+10 Active_file_bytes:1.200357376e+09 AnonHugePages_bytes:2.9645340672e+10 AnonPages_bytes:3.1900946432e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.685577728e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7171085312e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:2.2396928e+07 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7309696e+07 Inactive_bytes:4.86776832e+08 Inactive_file_bytes:4.69467136e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.2689408e+08 MemAvailable_bytes:1.6540602368e+10 MemFree_bytes:1.5186251776e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.6110208e+07 SReclaimable_bytes:8.1948672e+07 SUnreclaim_bytes:1.1921408e+08 Shmem_bytes:1.7846272e+07 Slab_bytes:2.01162752e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:14.40777+08:00 WARN [24352,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T16:53:35.82094+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.190464512e+10 Active_bytes:3.3105317888e+10 Active_file_bytes:1.200672768e+09 AnonHugePages_bytes:2.9645340672e+10 AnonPages_bytes:3.1904608256e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.685942272e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7156929536e+10 DirectMap2M_bytes:5.041553408e+10 DirectMap4k_bytes:1.1239424e+09 Dirty_bytes:2.279424e+07 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:4.86801408e+08 Inactive_file_bytes:4.69499904e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.26849024e+08 MemAvailable_bytes:1.655195648e+10 MemFree_bytes:1.5197257728e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.6102016e+07 SReclaimable_bytes:8.1952768e+07 SUnreclaim_bytes:1.1921408e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.01166848e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67870208e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T16:53:39.68381+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:14.65391+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=42.128527465, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T16:53:14.28465+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T16:53:14.72904+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T16:53:14.4079+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T16:53:35.91438+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:35.95397+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T16:53:14.50126+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T16:53:14.44585+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T16:53:14.55339+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T16:53:35.95583+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:53:35.95797+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=42.858256607, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:57:51.85558+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T16:53:36.01817+08:00 WARN [24352,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) QUERY_TIMEOUT(100000000) */ count(*) as cnt from gv$table where table_type in (5) and index_status in (5, 6) 2023-07-21T16:53:35.97591+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.027227127, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:36.01947+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.020010749, err="couldn't get SNTP reply: read udp 127.0.0.1:41619->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T16:53:36.02002+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.012152937, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T16:53:36.02017+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.013110765, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T16:53:36.02307+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:39.70399+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T16:52:47.59358+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T16:53:12.91248+08:00 ERROR [24352,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T16:53:39.70651+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T16:53:25.82367+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:39.7073+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:13.92925+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=30.612483713, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T16:53:26.28636+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.040033002, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T16:53:26.20459+08:00 WARN [24352,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T16:53:26.22847+08:00 INFO [24352,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:16:11.92342+08:00 INFO [25987,] caller=sdk/sdk_init.go:43:InitSDK: init sdk conf {ConfigPropertiesDir:conf/config_properties ModuleConfigDir:conf/module_config CryptoPath:conf/.config_secret.key CryptoMethod:plain} 2023-07-21T17:16:11.92578+08:00 INFO [25987,] caller=config/config_reader_writer.go:218:loadYamlFilesFromPath: read config files from path /home/admin/obagent/conf/config_properties 2023-07-21T17:16:11.92651+08:00 INFO [25987,] caller=config/config_reader_writer.go:224:loadYamlFilesFromPath: read config from path /home/admin/obagent/conf/config_properties, files length 2 2023-07-21T17:16:11.93688+08:00 INFO [25987,] caller=config/config_reader_writer.go:218:loadYamlFilesFromPath: read config files from path /home/admin/obagent/conf/module_config 2023-07-21T17:16:11.93744+08:00 INFO [25987,] caller=config/config_reader_writer.go:224:loadYamlFilesFromPath: read config from path /home/admin/obagent/conf/module_config, files length 6 2023-07-21T17:16:12.06117+08:00 INFO [25987,] caller=monagent/main.go:100:runMonitorAgent: sdk inited 2023-07-21T17:16:12.06332+08:00 INFO [25987,] caller=sdk/monagent_callbacks.go:104:func8: module monagent.admin.basic.auth init config sucessfully 2023-07-21T17:16:12.06597+08:00 INFO [25987,] caller=sdk/monagent_callbacks.go:73:func5: module monagent.server.basic.auth init config sucessfully 2023-07-21T17:16:12.07204+08:00 WARN [25987,] caller=engine/pipeline_module_callback.go:115:InitPipelineModuleCallback: pipeline module monitor.mysql is inactive, just skip 2023-07-21T17:16:12.0835+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=info, fields.msg="Parsed flag --collector.filesystem.mount-points-exclude", flag="^/(dev|proc|sys|var/lib/docker/.+)($|/)" 2023-07-21T17:16:12.08432+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=info, fields.msg="Parsed flag --collector.filesystem.fs-types-exclude", flag="^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$" 2023-07-21T17:16:12.09069+08:00 INFO [25987,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:HOST svr_ip:172.118.81.152]} 2023-07-21T17:16:12.0916+08:00 INFO [25987,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T17:16:12.09182+08:00 INFO [25987,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/node/host 2023-07-21T17:16:12.09231+08:00 INFO [25987,] caller=engine/pipeline_module_callback.go:33:addPipeline: add pipeline module result succeed 2023-07-21T17:16:12.257+08:00 INFO [25987,] caller=mysql/table_input.go:144:Init: table input init with config&{0 0xc0001d1be0 map[ob_is_rootservice:false ob_is_v3:false ob_is_v4:false ob_svr_ip:172.118.81.152 ob_svr_port:2882] [0xc000412280 0xc000412300 0xc000412380 0xc000412400 0xc000412480 0xc000412500 0xc000412580 0xc000412600 0xc000412680 0xc000412700 0xc000412780 0xc000412800 0xc000412980 0xc000412a00 0xc000412a80 0xc000412b00] 4} 2023-07-21T17:16:12.26848+08:00 INFO [25987,] caller=mysql/table_input.go:161:Init: successfully init mysql table input plugin 2023-07-21T17:16:12.27057+08:00 INFO [25987,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:OB ob_cluster_id:20230720 ob_cluster_name:obce-3zones obzone:zone2 svr_ip:172.118.81.152]} 2023-07-21T17:16:12.27134+08:00 INFO [25987,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T17:16:12.32693+08:00 INFO [25987,] caller=mysql/table_input.go:144:Init: table input init with config&{0 0xc000408280 map[ob_is_rootservice:false ob_is_v3:false ob_is_v4:false ob_svr_ip:172.118.81.152 ob_svr_port:2882] [0xc000412100 0xc000412180 0xc000412b80 0xc000412c00 0xc000412c80 0xc000412d00 0xc000412e00 0xc000412e80 0xc000412f00 0xc000412f80 0xc000413000 0xc000413080 0xc000413100 0xc000413200] 4} 2023-07-21T17:16:12.38107+08:00 INFO [25987,] caller=mysql/table_input.go:161:Init: successfully init mysql table input plugin 2023-07-21T17:16:12.38253+08:00 INFO [25987,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:OB ob_cluster_id:20230720 ob_cluster_name:obce-3zones obzone:zone2 svr_ip:172.118.81.152]} 2023-07-21T17:16:12.383+08:00 INFO [25987,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T17:16:12.38322+08:00 INFO [25987,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/ob/basic 2023-07-21T17:16:12.3836+08:00 INFO [25987,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/ob/extra 2023-07-21T17:16:12.38426+08:00 INFO [25987,] caller=engine/pipeline_module_callback.go:33:addPipeline: add pipeline module result succeed 2023-07-21T17:16:12.41002+08:00 WARN [25987,] caller=engine/pipeline_module_callback.go:115:InitPipelineModuleCallback: pipeline module monitor.ob.log is inactive, just skip 2023-07-21T17:16:12.59617+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:12.5992+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:12.60617+08:00 INFO [25987,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server 2023-07-21T17:16:12.60899+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:12.64528+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_plan_cache 2023-07-21T17:16:12.64726+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:12.64662+08:00 INFO [25987,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server 2023-07-21T17:16:12.64525+08:00 INFO [25987,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_partition 2023-07-21T17:16:12.68699+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:12.68767+08:00 INFO [25987,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_partition 2023-07-21T17:16:12.69894+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:12.72287+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:16:12.76302+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ group_concat(svr_ip SEPARATOR ',') as servers, status, count(1) as cnt from __all_server group by status 2023-07-21T17:16:13.01071+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) QUERY_TIMEOUT(100000000) */ tenant_name, 1 as role, case when cnt is null then 0 else cnt end as cnt from (select __all_tenant.tenant_name, t1.cnt from __all_tenant left join (select tenant_id, count(*) as cnt from __all_virtual_partition_info where svr_ip = ? and svr_port = ? group by tenant_id) t1 on __all_tenant.tenant_id = t1.tenant_id) t2 2023-07-21T17:16:13.05337+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:16:13.07742+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:16:13.08699+08:00 WARN [25987,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T17:16:13.17639+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:16:14.80347+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:14.87926+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:15.14951+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:15.15338+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:15.15383+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:14.98445+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.430652192, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:15.18106+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:16:15.19885+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:16:15.1995+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:16:15.44237+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:15.44374+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:15.44443+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:15.5964+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:15.59783+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:16:15.59569+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:16:15.60077+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:16:15.60092+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:16:15.60221+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:15.60629+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:16:15.60723+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.612419123, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:15.61019+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:15.61052+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:16:15.61241+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:16:15.61372+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:16:15.61394+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:15.61455+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:16:15.61463+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:15.70741+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:15.70806+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:16:15.73269+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:16:15.74001+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:16:15.70872+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:16:15.74031+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:16:15.84861+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:16:15.61413+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.0951366656e+10 Active_bytes:3.228674048e+10 Active_file_bytes:1.335373824e+09 AnonHugePages_bytes:2.958032896e+10 AnonPages_bytes:3.0958231552e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837027328e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6608241664e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:348160 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03271424e+08 Inactive_file_bytes:4.8596992e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.26029824e+08 MemAvailable_bytes:1.364021248e+10 MemFree_bytes:1.6009367552e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.3875456e+07 SReclaimable_bytes:8.6216704e+07 SUnreclaim_bytes:1.17919744e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04136448e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:15.84873+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:16:15.79377+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:16.00235+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.37999107, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:16.00845+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T17:16:15.99795+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:16.01284+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:15.99134+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:16:16.01306+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T17:16:16.14759+08:00 WARN [25987,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T17:16:16.25088+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:16.25546+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T17:16:16.25642+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T17:16:16.25598+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:16.25781+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T17:16:16.06764+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:16.24088+08:00 INFO [25987,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_disk 2023-07-21T17:16:16.34876+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T17:16:16.35147+08:00 INFO [25987,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_disk 2023-07-21T17:16:16.35086+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:16:16.35363+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001493308, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:16.36034+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T17:16:16.34802+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:16.28036+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:16.51919+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:16.45877+08:00 INFO [25987,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T17:16:16.52051+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:16:16.52038+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:16.26444+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:16:16.51918+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:16.28531+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:16:16.89277+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T17:16:16.89581+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:16.91654+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:16.93003+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:16.90272+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:16.93134+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:16.93996+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:16.94192+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:16.93198+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:16.44428+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.596105698, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:16.94465+08:00 INFO [25987,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_disk 2023-07-21T17:16:16.94449+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:17.05509+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.0838+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=12.35 2023-07-21T17:16:17.12017+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ total_size, free_size from __all_virtual_disk_stat where svr_ip = ? and svr_port = ? 2023-07-21T17:16:17.13567+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:16.82278+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:17.17975+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=17.13 2023-07-21T17:16:17.17943+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.13576+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:17.2106+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:17.20883+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.20852+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=28.94 2023-07-21T17:16:17.27335+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:17.27607+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.332836333, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:16:17.27629+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:17.27533+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:17.27676+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.27703+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:17.27838+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:17.27861+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:17.28003+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.130079573, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:16:17.31985+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:17.28514+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.005648484, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:17.3218+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:16.94197+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.044603197, err="couldn't get SNTP reply: read udp 127.0.0.1:22475->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:17.32523+08:00 INFO [25987,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T17:16:17.32514+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:16.9399+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.32347+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:17.37296+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:17.36851+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.32347+08:00 INFO [25987,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_disk 2023-07-21T17:16:17.38249+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:17.36727+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:17.38402+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:16:17.42259+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:16:17.4165+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:17.4311+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:17.41581+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.43433+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:17.4223+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:16:17.32582+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:17.42213+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:16:17.45082+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:17.46002+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:17.43242+08:00 INFO [25987,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T17:16:17.46203+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:17.44346+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.44152+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:17.47223+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:16.94334+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:17.46616+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:16:17.47292+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.4738+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:17.4745+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.43473+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.537512347, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:17.47458+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:17.46831+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ total_size, free_size from __all_virtual_disk_stat where svr_ip = ? and svr_port = ? 2023-07-21T17:16:17.47529+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:17.46831+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:17.47668+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:16:17.47435+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.062845414, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:17.47728+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:16:17.47264+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:17.48088+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:16:17.47754+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:17.48525+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:17.4809+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:16:17.48408+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:17.4853+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:17.59825+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:17.61086+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:17.60901+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:16:17.66117+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ cpu_total,cpu_assigned,mem_total,mem_assigned,disk_total,disk_assigned,unit_num,migrating_unit_num,cpu_assigned_percent, mem_assigned_percent, disk_assigned_percent from __all_virtual_server_stat where svr_ip = ? and svr_port = ? 2023-07-21T17:16:17.48675+08:00 INFO [25987,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T17:16:17.70432+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:16:17.6611+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:17.70556+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:17.70619+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:17.7071+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:17.60938+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:16:17.48504+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.596507602, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:16:17.48684+08:00 WARN [25987,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T17:16:17.71672+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:17.66133+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:16:17.72006+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:16:17.50758+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:16:17.86297+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:17.662+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:16:17.60969+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:16:17.48484+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=17.6 2023-07-21T17:16:17.66215+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:17.70585+08:00 INFO [25987,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T17:16:17.72326+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:17.86246+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:17.66195+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:17.87539+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.14 2023-07-21T17:16:17.87749+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.87738+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:16:17.72017+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:17.87768+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.2 2023-07-21T17:16:17.87848+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:17.87919+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.39861555, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:16:17.87577+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:16:17.87887+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001088457, err="couldn't get SNTP reply: read udp 127.0.0.1:43218->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:17.87959+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000715793, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:17.72058+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.88005+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:16:17.66134+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:17.87832+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.88094+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:16:17.66144+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:16:17.62196+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1007633408e+10 Active_bytes:3.2343089152e+10 Active_file_bytes:1.335455744e+09 AnonHugePages_bytes:2.9584523264e+10 AnonPages_bytes:3.1006420992e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837105152e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.662911488e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:442368 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03267328e+08 Inactive_file_bytes:4.85965824e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.26558208e+08 MemAvailable_bytes:1.3585641472e+10 MemFree_bytes:1.5954755584e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.3773056e+07 SReclaimable_bytes:8.6216704e+07 SUnreclaim_bytes:1.17723136e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.0393984e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:17.87558+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:16:17.87974+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:18.00755+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ cpu_total,cpu_assigned,mem_total,mem_assigned,disk_total,disk_assigned,unit_num,migrating_unit_num,cpu_assigned_percent, mem_assigned_percent, disk_assigned_percent from __all_virtual_server_stat where svr_ip = ? and svr_port = ? 2023-07-21T17:16:17.87938+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:17.88228+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:18.01584+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:16:18.01424+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.88162+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=17.6 2023-07-21T17:16:18.01767+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:18.01828+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:18.02556+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:18.03076+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000370675, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:17.88095+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:18.02615+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:17.96347+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:16:18.019+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:18.03533+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.232149691, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:16:18.02242+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:16:18.03634+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.14 2023-07-21T17:16:18.01274+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:18.03726+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.2 2023-07-21T17:16:18.03398+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:18.03807+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.158571491, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:16:18.03829+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:17.88192+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.497349961, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:18.03852+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu21, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:18.04538+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu21, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:18.03958+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:18.03761+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:16:18.03947+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:16:18.07145+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:16:17.87943+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:16:18.43229+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.955264703, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:18.47288+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:18.4327+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.278621062, err="couldn't get SNTP reply: read udp 127.0.0.1:19575->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:18.52042+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:16.45878+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=12.35 2023-07-21T17:16:18.56699+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:18.55082+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=17.13 2023-07-21T17:16:18.65738+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:18.64918+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=28.94 2023-07-21T17:16:18.81028+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.36598506, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:16:18.70966+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:18.86722+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:16:18.88376+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=0, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=74483.96, old_value=74484.85 2023-07-21T17:16:18.88894+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=0, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=5701.99, old_value=5702.07 2023-07-21T17:16:18.89227+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=0, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=2326.81, old_value=2326.92 2023-07-21T17:16:18.89355+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=0, fields.level=debug, fields.msg="CPU SoftIRQ counter jumped backwards", new_value=95.63, old_value=95.64 2023-07-21T17:16:18.89629+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=1, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=75195.57, old_value=75196.45 2023-07-21T17:16:18.89385+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1045476352e+10 Active_bytes:3.2380977152e+10 Active_file_bytes:1.3355008e+09 AnonHugePages_bytes:2.9595009024e+10 AnonPages_bytes:3.1045984256e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837154304e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6640288768e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:491520 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03267328e+08 Inactive_file_bytes:4.85965824e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.26590976e+08 MemAvailable_bytes:1.3548490752e+10 MemFree_bytes:1.5917584384e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4047488e+07 SReclaimable_bytes:8.6216704e+07 SUnreclaim_bytes:1.17723136e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.0393984e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:18.90945+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=1, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=5589.11, old_value=5589.16 2023-07-21T17:16:18.91052+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=1, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=2326.33, old_value=2326.4 2023-07-21T17:16:16.93085+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:18.92506+08:00 INFO [25987,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T17:16:18.92958+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=2, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=75341.23, old_value=75342.11 2023-07-21T17:16:18.93676+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=2, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=5497.41, old_value=5497.48 2023-07-21T17:16:18.89637+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.0976815104e+10 Active_bytes:3.2312188928e+10 Active_file_bytes:1.335373824e+09 AnonHugePages_bytes:2.958032896e+10 AnonPages_bytes:3.0976057344e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837027328e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6618326016e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:348160 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03271424e+08 Inactive_file_bytes:4.8596992e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.26029824e+08 MemAvailable_bytes:1.3618487296e+10 MemFree_bytes:1.5987642368e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.3875456e+07 SReclaimable_bytes:8.6216704e+07 SUnreclaim_bytes:1.17919744e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04136448e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:18.93779+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:18.93584+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:18.92723+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:18.93789+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.03272774, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:18.94684+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=2, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=2310.85, old_value=2310.95 2023-07-21T17:16:18.94903+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:18.94861+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:18.94835+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:18.96177+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.404155717, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:18.95593+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=2, fields.level=debug, fields.msg="CPU Iowait counter jumped backwards", new_value=75.54, old_value=75.55 2023-07-21T17:16:18.95537+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:18.96172+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:18.95424+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:18.96604+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=2, fields.level=debug, fields.msg="CPU SoftIRQ counter jumped backwards", new_value=13.67, old_value=13.68 2023-07-21T17:16:18.96353+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:16:19.05932+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:19.08677+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=3, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=75158.83, old_value=75159.76 2023-07-21T17:16:19.07942+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:16:19.09671+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:16:19.08755+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:19.06382+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:19.08707+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.921338082, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:19.10016+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=3, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=5690.05, old_value=5690.1 2023-07-21T17:16:19.08667+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:16:19.0968+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:16:19.10389+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:19.09723+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.158133294, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:19.10083+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:19.09941+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.143863625, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:19.09989+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:16:19.11297+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=3, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=2298.38, old_value=2298.47 2023-07-21T17:16:19.11324+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:19.11834+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:16:19.50258+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:19.49933+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=4, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=75608.4, old_value=75609.3 2023-07-21T17:16:19.51476+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:19.51495+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=4, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=5398.59, old_value=5398.64 2023-07-21T17:16:19.51506+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:16:19.1079+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1065350144e+10 Active_bytes:3.2400850944e+10 Active_file_bytes:1.3355008e+09 AnonHugePages_bytes:2.9595009024e+10 AnonPages_bytes:3.1067152384e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837154304e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6644233216e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:491520 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03267328e+08 Inactive_file_bytes:4.85965824e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.26590976e+08 MemAvailable_bytes:1.3527724032e+10 MemFree_bytes:1.5896817664e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4047488e+07 SReclaimable_bytes:8.6216704e+07 SUnreclaim_bytes:1.17723136e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.0393984e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:19.41174+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:16:19.51626+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=4, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=2208.96, old_value=2209.1 2023-07-21T17:16:19.51775+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=5, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=76023.08, old_value=76023.94 2023-07-21T17:16:19.51633+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:16:19.51869+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=5, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=5055.74, old_value=5055.78 2023-07-21T17:16:19.5167+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:16:19.66586+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:16:19.66669+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:16:19.66734+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:16:19.66933+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=5, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=2242.16, old_value=2242.3 2023-07-21T17:16:19.67243+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=6, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=76218.24, old_value=76219.01 2023-07-21T17:16:19.67283+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:16:19.67318+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=6, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=4806, old_value=4806.04 2023-07-21T17:16:19.67372+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:16:19.66789+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:16:19.67559+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:16:19.67759+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:16:19.67848+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ cpu_total,cpu_assigned,mem_total,mem_assigned,disk_total,disk_assigned,unit_num,migrating_unit_num,cpu_assigned_percent, mem_assigned_percent, disk_assigned_percent from __all_virtual_server_stat where svr_ip = ? and svr_port = ? 2023-07-21T17:16:19.67893+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T17:16:19.6794+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T17:16:19.67914+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=6, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=2108.12, old_value=2108.32 2023-07-21T17:16:19.68208+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=6, fields.level=debug, fields.msg="CPU SoftIRQ counter jumped backwards", new_value=113.05, old_value=113.06 2023-07-21T17:16:19.68254+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:16:19.68351+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=7, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=76292.39, old_value=76293.01 2023-07-21T17:16:19.68277+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T17:16:19.6846+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=7, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=4700.76, old_value=4700.8 2023-07-21T17:16:19.10695+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.10703104e+10 Active_bytes:3.24058112e+10 Active_file_bytes:1.3355008e+09 AnonHugePages_bytes:2.9595009024e+10 AnonPages_bytes:3.1070380032e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837154304e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6645269504e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:491520 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03267328e+08 Inactive_file_bytes:4.85965824e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.26590976e+08 MemAvailable_bytes:1.3523779584e+10 MemFree_bytes:1.5892873216e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4047488e+07 SReclaimable_bytes:8.6216704e+07 SUnreclaim_bytes:1.17723136e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.0393984e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:19.68607+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T17:16:19.68595+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=7, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=2080.27, old_value=2080.49 2023-07-21T17:16:19.6872+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T17:16:19.68733+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=7, fields.level=debug, fields.msg="CPU SoftIRQ counter jumped backwards", new_value=133.74, old_value=133.75 2023-07-21T17:16:19.68746+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:16:19.68745+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000486408, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:19.6879+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T17:16:19.68795+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:16:19.68914+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:16:19.68992+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T17:16:19.68975+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.588947898, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:19.68859+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=8, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=76487.41, old_value=76488.22 2023-07-21T17:16:19.6911+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:16:19.69215+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:16:19.69269+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=8, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=4854.73, old_value=4854.78 2023-07-21T17:16:19.69298+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:16:19.69648+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=8, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=2057.81, old_value=2057.94 2023-07-21T17:16:19.69703+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:16:19.69488+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000779459, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:19.69455+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:16:19.69747+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=9, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=76780.65, old_value=76781.4 2023-07-21T17:16:19.69808+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:16:19.70547+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T17:16:19.70624+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:19.70683+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=9, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=4654.16, old_value=4654.22 2023-07-21T17:16:19.70547+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T17:16:19.7065+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:16:19.78123+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:16:19.70759+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:16:19.78185+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:16:19.70666+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=17.6 2023-07-21T17:16:19.7878+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T17:16:19.78346+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=9, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=2078.42, old_value=2078.62 2023-07-21T17:16:19.80317+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=10, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=76960.31, old_value=76960.9 2023-07-21T17:16:19.81148+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T17:16:19.78792+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T17:16:19.81376+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=10, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=4459.81, old_value=4459.87 2023-07-21T17:16:19.80037+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:19.82241+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:16:19.8508+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:16:19.78776+08:00 INFO [25987,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T17:16:19.70656+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.007923318, err="couldn't get SNTP reply: read udp 127.0.0.1:42444->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:19.78907+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T17:16:19.81468+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.14 2023-07-21T17:16:19.85445+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T17:16:19.8688+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T17:16:19.85593+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T17:16:19.86933+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T17:16:19.87868+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T17:16:19.87929+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T17:16:19.86632+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:17.99672+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:16:19.90539+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.199858577, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:19.86745+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.112400896e+10 Active_bytes:3.2459534336e+10 Active_file_bytes:1.335525376e+09 AnonHugePages_bytes:2.9603397632e+10 AnonPages_bytes:3.1121723392e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837174784e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6661522432e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:512000 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03263232e+08 Inactive_file_bytes:4.85961728e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.26681088e+08 MemAvailable_bytes:1.346772992e+10 MemFree_bytes:1.5836811264e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4395648e+07 SReclaimable_bytes:8.6216704e+07 SUnreclaim_bytes:1.17731328e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.03948032e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:19.93456+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:16:19.93619+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:19.93641+08:00 INFO [25987,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T17:16:19.93672+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:19.93789+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:16:19.93836+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.235044824, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:19.94042+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:16:19.94266+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:16:19.94647+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:16:19.84307+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=10, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=2001.47, old_value=2001.67 2023-07-21T17:16:19.86619+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.809493273, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:19.94721+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T17:16:19.93393+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.048704117, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:17.99701+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:16:19.87269+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T17:16:19.86434+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T17:16:19.86488+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T17:16:17.99749+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00080608, err="couldn't get SNTP reply: read udp 127.0.0.1:30560->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:18.00369+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:16:18.07207+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:16:19.86806+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.2 2023-07-21T17:16:19.9475+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:20.14519+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:18.07415+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu22, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:20.1181+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:20.56016+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu22, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:20.5613+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu23, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:18.07108+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:20.12292+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:16:20.15293+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:20.61541+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:16:19.95381+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=11, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=76920.17, old_value=76921.03 2023-07-21T17:16:19.95461+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:20.56213+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:20.5584+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:16:20.56223+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:19.96097+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000592821, err="couldn't get SNTP reply: read udp 127.0.0.1:37491->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:19.96395+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=17.6 2023-07-21T17:16:20.56246+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:19.97265+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T17:16:20.56304+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:20.61658+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:16:20.58463+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:20.56252+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.593939056, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:16:20.61562+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:16:19.95602+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:19.94786+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T17:16:20.11845+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:16:19.96004+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:20.07833+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.103668667, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:20.06166+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:20.11203+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:20.11209+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:20.11577+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:20.11405+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:16:20.11207+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ cpu_total,cpu_assigned,mem_total,mem_assigned,disk_total,disk_assigned,unit_num,migrating_unit_num,cpu_assigned_percent, mem_assigned_percent, disk_assigned_percent from __all_virtual_server_stat where svr_ip = ? and svr_port = ? 2023-07-21T17:16:20.11465+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:19.94797+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:20.11793+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:20.1236+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:16:20.11547+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:20.11507+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:16:20.14971+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:19.86765+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:20.15747+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:16:20.56315+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:16:20.13431+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T17:16:20.12922+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.659408617, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:16:20.16463+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.215483122, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:20.13445+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T17:16:20.13661+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:19.97052+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:19.94768+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:20.56231+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:16:20.577+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:20.56297+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:20.61628+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:16:20.61645+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:20.57064+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:16:20.62708+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:20.61629+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:16:20.6265+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=11, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=4350, old_value=4350.05 2023-07-21T17:16:20.62786+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu23, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:20.62782+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.8998754909999995, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T17:16:20.63229+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:16:20.62949+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:20.77736+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:16:20.77743+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:20.77835+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:16:20.78653+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:16:20.78925+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:16:20.78866+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:16:20.78653+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:20.79004+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.14 2023-07-21T17:16:20.79017+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:20.79105+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:20.62842+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:20.79343+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:20.7938+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T17:16:20.79134+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:16:20.95075+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:16:20.93805+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T17:16:20.96944+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:21.04386+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:21.13364+08:00 WARN [25987,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T17:16:21.17155+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T17:16:21.1943+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:21.17282+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:16:21.20162+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:16:21.20505+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:21.20653+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:21.21561+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:21.21582+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:21.21727+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:16:21.23819+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:21.24935+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:16:21.2702+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=11, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=1935.62, old_value=1935.74 2023-07-21T17:16:21.27296+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu3, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:21.27399+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.5679680940000003, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:16:21.27484+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:16:19.12188+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:19.12416+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:19.22991+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:19.2776+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.816853174, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:16:19.34344+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000653006, err="couldn't get SNTP reply: read udp 127.0.0.1:30237->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:19.2527+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:19.34558+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:19.4029+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.414880533, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:16:19.40013+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:16:19.40037+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.281381187, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:21.28363+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.2 2023-07-21T17:16:21.34884+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:21.40616+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:16:21.40573+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:21.4624+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:16:21.46263+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:16:21.46279+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:16:21.46214+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:16:21.47473+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:16:21.48613+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:21.57996+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:16:21.5837+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:16:21.5812+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1174340608e+10 Active_bytes:3.2509952e+10 Active_file_bytes:1.335611392e+09 AnonHugePages_bytes:2.9609689088e+10 AnonPages_bytes:3.117418496e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.8372608e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6674269184e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:602112 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03271424e+08 Inactive_file_bytes:4.8596992e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.26738432e+08 MemAvailable_bytes:1.3417709568e+10 MemFree_bytes:1.5786737664e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5067392e+07 SReclaimable_bytes:8.6233088e+07 SUnreclaim_bytes:1.17747712e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.039808e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:21.58974+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:16:21.64047+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.744098321, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T17:16:21.66735+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:21.6666+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T17:16:21.5898+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:21.58386+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:16:21.60868+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:16:21.67484+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:22.08605+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.028270323, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:22.08653+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:22.09344+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:21.68503+08:00 ERROR [25987,] caller=engine/route_manager.go:173:pull: failed to write http response from buffer fields: error="write tcp 172.118.81.152:8088->172.118.81.152:15574: write: broken pipe" 2023-07-21T17:16:22.15234+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.425689848, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:22.09409+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=17.6 2023-07-21T17:16:22.1692+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=17.6 2023-07-21T17:16:22.15451+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002235323, err="couldn't get SNTP reply: read udp 127.0.0.1:45463->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:22.22326+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:22.28714+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:22.40171+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.004346545, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:22.40224+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:22.42178+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:22.4397+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:22.42834+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:22.42755+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:16:22.61171+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu3, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:22.61172+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.0407978, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:22.43859+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.031385666, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:22.76075+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:16:22.61019+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.023678615, err="couldn't get SNTP reply: read udp 127.0.0.1:8111->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:22.40343+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1192641536e+10 Active_bytes:3.2528265216e+10 Active_file_bytes:1.33562368e+09 AnonHugePages_bytes:2.960130048e+10 AnonPages_bytes:3.1192645632e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837277184e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6684382208e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:618496 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03271424e+08 Inactive_file_bytes:4.8596992e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.26779392e+08 MemAvailable_bytes:1.3399412736e+10 MemFree_bytes:1.576843264e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5276288e+07 SReclaimable_bytes:8.6233088e+07 SUnreclaim_bytes:1.17747712e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.039808e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:22.60551+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.598373607, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:22.78105+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:16:22.78199+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:16:22.85944+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:16:22.86234+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=18.6 2023-07-21T17:16:22.86227+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.256720084, err="couldn't get SNTP reply: read udp 127.0.0.1:58641->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:22.76488+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=11, fields.level=debug, fields.msg="CPU SoftIRQ counter jumped backwards", new_value=139.42, old_value=139.43 2023-07-21T17:16:23.04119+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:23.55368+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:23.50629+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:23.55683+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:23.56739+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:23.61709+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:23.55233+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:22.88093+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=18.6 2023-07-21T17:16:23.55526+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.793789834, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:23.28809+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.248395532, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:23.63669+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.287926663, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:16:23.63784+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:23.7644+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:23.66693+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:16:23.83502+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.871891828, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:16:23.83595+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:23.91969+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:23.96252+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:16:24.27485+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.121565696e+10 Active_bytes:3.2551288832e+10 Active_file_bytes:1.335631872e+09 AnonHugePages_bytes:2.9615980544e+10 AnonPages_bytes:3.1231197184e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837289472e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6735410176e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:630784 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.0327552e+08 Inactive_file_bytes:4.85974016e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.26799872e+08 MemAvailable_bytes:1.337581568e+10 MemFree_bytes:1.5744831488e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.55712e+07 SReclaimable_bytes:8.6233088e+07 SUnreclaim_bytes:1.17747712e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.039808e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:24.27492+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:24.2912+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=18.6 2023-07-21T17:16:24.39508+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000743296, err="couldn't get SNTP reply: read udp 127.0.0.1:20166->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:24.27548+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.003860464, err="couldn't get SNTP reply: read udp 127.0.0.1:63417->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:24.4475+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:24.35146+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.004989436, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:25.0185+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:25.07524+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000476419, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:25.07957+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.014967237, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:25.0784+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:25.07464+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:25.07671+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002128109, err="couldn't get SNTP reply: read udp 127.0.0.1:24981->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:26.84596+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:26.83569+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:26.84047+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:16:26.83593+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:26.84841+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:26.85079+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:27.08729+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:26.85077+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:26.85265+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:16:27.04744+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.823173407, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:16:27.23142+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:26.84299+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:26.99291+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:16:27.04388+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:16:27.24754+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=12, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=64899.21, old_value=64900.03 2023-07-21T17:16:27.23165+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:16:27.2435+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:27.24914+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:27.24953+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:27.26103+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:16:27.24953+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:16:27.26125+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:16:27.25313+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:16:27.12587+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:16:27.36262+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:16:27.35474+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:16:27.26327+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=23.27 2023-07-21T17:16:27.44276+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:16:27.45514+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.362962051, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:27.44179+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:16:27.44266+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.595025574, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:27.4558+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00077649, err="couldn't get SNTP reply: read udp 127.0.0.1:22199->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:27.36429+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.269484563, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:27.38504+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:27.35474+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:16:27.80864+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001810232, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:27.80561+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.33 2023-07-21T17:16:27.81498+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:27.8149+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:27.81883+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:27.81992+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=12, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=13612.98, old_value=13613.16 2023-07-21T17:16:27.81534+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=23.27 2023-07-21T17:16:27.81763+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:27.81902+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:27.81937+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:27.82306+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=19.31 2023-07-21T17:16:25.8374+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:27.82371+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:27.82317+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:27.82235+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:27.83654+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.2 2023-07-21T17:16:21.4866+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T17:16:27.84499+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:27.89561+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:27.93806+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:27.87095+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:27.97601+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=23.27 2023-07-21T17:16:27.98704+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:16:22.3539+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:28.06285+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=12, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=1899.62, old_value=1899.68 2023-07-21T17:16:28.13549+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=23.27 2023-07-21T17:16:28.13681+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:28.24472+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:16:29.1943+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.012246228, err="couldn't get SNTP reply: read udp 127.0.0.1:36265->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:29.2453+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:30.18995+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:30.18678+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=23.27 2023-07-21T17:16:30.19937+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:30.39161+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:30.19236+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:30.19929+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:30.62183+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:30.87626+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:30.33502+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:30.39844+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:30.39936+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.020156214, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:30.40509+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:30.76585+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:16:30.40356+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:30.88677+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.695325074, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:30.94077+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:31.14181+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:31.14614+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.68893234, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:31.14626+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.504464474, err="couldn't get SNTP reply: read udp 127.0.0.1:56851->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:31.25015+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:31.42843+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:30.85947+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:30.39977+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.276788871, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:30.19256+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:30.39098+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.15198988, err="couldn't get SNTP reply: read udp 127.0.0.1:57774->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:30.19237+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:30.69659+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:30.88675+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:31.45539+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=13, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=66742.82, old_value=66743.79 2023-07-21T17:16:31.14853+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=23.27 2023-07-21T17:16:31.44854+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:31.46508+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=8.981713933, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:31.46294+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.069321551, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:31.59264+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=19.31 2023-07-21T17:16:31.98581+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:32.29647+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=19.31 2023-07-21T17:16:32.42401+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:32.54263+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:32.54124+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:32.54102+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.449289124, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:32.54451+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:32.56934+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:32.62241+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:32.63955+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:32.70033+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:32.56403+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:32.73254+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:32.73344+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:32.71931+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:32.53995+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:32.55881+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:32.7339+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:32.83659+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:32.8111+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:32.84436+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=19.31 2023-07-21T17:16:32.83679+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:32.84439+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=13, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=12245.19, old_value=12245.29 2023-07-21T17:16:32.83613+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:32.8448+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:32.87019+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.46 2023-07-21T17:16:21.516+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T17:16:32.87094+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:32.87085+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:32.87152+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:32.87148+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:32.87188+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:22.35576+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.530467798, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:22.35672+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:32.91384+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:32.99787+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:33.02202+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:33.02753+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:33.07439+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:33.07414+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.46 2023-07-21T17:16:33.07447+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.164306531, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:33.07465+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:33.07431+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:33.07542+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:33.09021+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:33.2711+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=27.41 2023-07-21T17:16:33.34866+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:35.68618+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1346176e+10 Active_bytes:3.2681992192e+10 Active_file_bytes:1.335816192e+09 AnonHugePages_bytes:2.9615980544e+10 AnonPages_bytes:3.1337762816e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837494272e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6813123584e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:389120 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03291904e+08 Inactive_file_bytes:4.859904e+08 KernelStack_bytes:2.37568e+07 Mapped_bytes:1.27164416e+08 MemAvailable_bytes:1.3240426496e+10 MemFree_bytes:1.5609339904e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.831552e+07 SReclaimable_bytes:8.6233088e+07 SUnreclaim_bytes:1.17972992e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.0420608e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:35.68609+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:35.68899+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:35.71163+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:16:35.57748+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000894553, err="couldn't get SNTP reply: read udp 127.0.0.1:29790->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:35.59735+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:36.05387+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:35.89539+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:36.07065+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:35.89033+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:35.89128+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.690604513, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:35.88991+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=27.41 2023-07-21T17:16:35.89598+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:35.63544+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:36.06643+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.048165285, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:35.87372+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:36.07137+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:36.07474+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.027686047, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:36.07158+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:36.07104+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:35.88186+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:35.8885+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:36.07524+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:36.07432+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:36.0725+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.01122789, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:36.07339+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.386989858, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:36.08013+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:36.08128+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=27.41 2023-07-21T17:16:35.68853+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1333265408e+10 Active_bytes:3.2669089792e+10 Active_file_bytes:1.335824384e+09 AnonHugePages_bytes:2.9609689088e+10 AnonPages_bytes:3.1333052416e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.83750656e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.679844352e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:401408 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03291904e+08 Inactive_file_bytes:4.859904e+08 KernelStack_bytes:2.37568e+07 Mapped_bytes:1.27164416e+08 MemAvailable_bytes:1.3252579328e+10 MemFree_bytes:1.562148864e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.8475264e+07 SReclaimable_bytes:8.6233088e+07 SUnreclaim_bytes:1.17989376e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04222464e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:36.07083+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:36.08055+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:36.08138+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:36.07718+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1332511744e+10 Active_bytes:3.2668348416e+10 Active_file_bytes:1.335836672e+09 AnonHugePages_bytes:2.9609689088e+10 AnonPages_bytes:3.133231104e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837518848e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6802637824e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:413696 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03287808e+08 Inactive_file_bytes:4.85986304e+08 KernelStack_bytes:2.37568e+07 Mapped_bytes:1.27164416e+08 MemAvailable_bytes:1.3249687552e+10 MemFree_bytes:1.5618592768e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.8618624e+07 SReclaimable_bytes:8.6233088e+07 SUnreclaim_bytes:1.1800576e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04238848e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:36.08149+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.031500525, err="couldn't get SNTP reply: read udp 127.0.0.1:54275->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:36.08243+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:36.08447+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:36.08281+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.246018821, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:36.08815+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:36.08031+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:36.08791+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:36.08989+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.09978385, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:36.08873+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.022445236, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:36.09134+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.46 2023-07-21T17:16:36.09065+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:36.06647+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.031147083, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:36.09143+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=27.41 2023-07-21T17:16:36.083+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:36.12134+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=13, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=1944.47, old_value=1944.53 2023-07-21T17:16:36.30126+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:36.40556+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:36.68748+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.041114306, err="couldn't get SNTP reply: read udp 127.0.0.1:55179->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:37.42145+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.5316561279999998, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:36.70433+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:36.69659+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=17.178551681, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:16:35.89166+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=27.41 2023-07-21T17:16:37.25267+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:37.41434+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.704628984, err="couldn't get SNTP reply: read udp 127.0.0.1:62247->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:36.69695+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.601502535, err="couldn't get SNTP reply: read udp 127.0.0.1:29882->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:37.5887+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:37.07307+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:37.57541+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:36.4056+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1332429824e+10 Active_bytes:3.2668254208e+10 Active_file_bytes:1.335824384e+09 AnonHugePages_bytes:2.9609689088e+10 AnonPages_bytes:3.1332118528e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837510656e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6801589248e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:405504 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03291904e+08 Inactive_file_bytes:4.859904e+08 KernelStack_bytes:2.37568e+07 Mapped_bytes:1.27164416e+08 MemAvailable_bytes:1.32516864e+10 MemFree_bytes:1.5620595712e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.8475264e+07 SReclaimable_bytes:8.6233088e+07 SUnreclaim_bytes:1.17989376e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04222464e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:38.13152+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=13.10289126, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:38.07014+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.349067125, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:37.52704+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=13.229667842, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:38.11749+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:37.57279+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:38.36574+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:38.04429+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.763076996, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:16:38.36522+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:38.818+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:38.81967+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.25791834, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:38.81759+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:38.81741+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:38.82304+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:38.93831+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:38.88957+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:25.35762+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:16:46.66226+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=19.210862089, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:39.34174+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:45.21067+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:25.08387+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1217283072e+10 Active_bytes:3.2552931328e+10 Active_file_bytes:1.335648256e+09 AnonHugePages_bytes:2.960130048e+10 AnonPages_bytes:3.1218151424e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837305856e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6736458752e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:647168 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.0327552e+08 Inactive_file_bytes:4.85974016e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26808064e+08 MemAvailable_bytes:1.3371969536e+10 MemFree_bytes:1.5740977152e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5788288e+07 SReclaimable_bytes:8.6233088e+07 SUnreclaim_bytes:1.17747712e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.039808e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:40.15681+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:40.15636+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=9.970964381, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:16:42.1478+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=28.98 2023-07-21T17:16:41.66+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000733775, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:42.14792+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:42.14907+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:42.1471+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001418065, err="couldn't get SNTP reply: read udp 127.0.0.1:54816->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:40.1627+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:42.56251+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:42.14815+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:43.26121+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=16.506398921, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:42.12498+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1387000832e+10 Active_bytes:3.2722931712e+10 Active_file_bytes:1.33593088e+09 AnonHugePages_bytes:2.9603397632e+10 AnonPages_bytes:3.1384244224e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837613056e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6847529984e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:466944 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03287808e+08 Inactive_file_bytes:4.85986304e+08 KernelStack_bytes:2.37568e+07 Mapped_bytes:1.2720128e+08 MemAvailable_bytes:1.3196476416e+10 MemFree_bytes:1.5565336576e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9405056e+07 SReclaimable_bytes:8.6233088e+07 SUnreclaim_bytes:1.18050816e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04283904e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:42.99753+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:43.90683+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:43.87333+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:42.24491+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:43.90704+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:43.91302+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=28.34 2023-07-21T17:16:42.99918+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1269236736e+10 Active_bytes:3.2604934144e+10 Active_file_bytes:1.335697408e+09 AnonHugePages_bytes:2.961178624e+10 AnonPages_bytes:3.1269507072e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837359104e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.67622144e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:360448 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03279616e+08 Inactive_file_bytes:4.85978112e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26820352e+08 MemAvailable_bytes:1.3320331264e+10 MemFree_bytes:1.5689310208e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.6603392e+07 SReclaimable_bytes:8.6233088e+07 SUnreclaim_bytes:1.17772288e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04005376e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:43.91357+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.404668876, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:44.1668+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:43.96441+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:43.99067+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:44.57897+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:43.91247+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:44.57919+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:44.61898+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:44.60754+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:44.79108+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.172975583, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:44.79187+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:44.62069+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:44.80735+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:44.81457+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:42.53444+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:44.80714+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=17.976253873, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:45.02228+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:43.35315+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:43.81045+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:25.35704+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:16:45.17+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:45.07203+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:44.81547+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=20.23 2023-07-21T17:16:44.78856+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:44.81421+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:45.2945+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:25.35732+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:16:45.15209+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:45.27809+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:45.2944+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:45.44139+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:45.51933+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.072885605, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:45.44101+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:45.56562+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=9.87879096, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:45.57062+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=18.74438823, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:45.56578+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1407607808e+10 Active_bytes:3.2743571456e+10 Active_file_bytes:1.335963648e+09 AnonHugePages_bytes:2.9605494784e+10 AnonPages_bytes:3.1408201728e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837641728e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6846481408e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:495616 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03296e+08 Inactive_file_bytes:4.85994496e+08 KernelStack_bytes:2.3773184e+07 Mapped_bytes:1.27205376e+08 MemAvailable_bytes:1.3177450496e+10 MemFree_bytes:1.5546281984e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9962112e+07 SReclaimable_bytes:8.6249472e+07 SUnreclaim_bytes:1.18136832e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04386304e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:45.34101+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1409098752e+10 Active_bytes:3.27450624e+10 Active_file_bytes:1.335963648e+09 AnonHugePages_bytes:2.9605494784e+10 AnonPages_bytes:3.1410429952e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837641728e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6847005696e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:495616 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03296e+08 Inactive_file_bytes:4.85994496e+08 KernelStack_bytes:2.3773184e+07 Mapped_bytes:1.27205376e+08 MemAvailable_bytes:1.3175545856e+10 MemFree_bytes:1.5544377344e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9962112e+07 SReclaimable_bytes:8.6249472e+07 SUnreclaim_bytes:1.18136832e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04386304e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:45.57459+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:24.51449+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:45.5749+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=14.633993002, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:16:44.80791+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1404965888e+10 Active_bytes:3.2740900864e+10 Active_file_bytes:1.335934976e+09 AnonHugePages_bytes:2.961178624e+10 AnonPages_bytes:3.1402983424e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837617152e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.685644288e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:471040 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03291904e+08 Inactive_file_bytes:4.859904e+08 KernelStack_bytes:2.37568e+07 Mapped_bytes:1.2720128e+08 MemAvailable_bytes:1.3180207104e+10 MemFree_bytes:1.5549054976e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9818752e+07 SReclaimable_bytes:8.6249472e+07 SUnreclaim_bytes:1.18095872e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04345344e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:45.57508+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:45.58577+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.5429801090000002, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:45.57522+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:45.60538+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:45.60523+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:45.7285+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:45.81525+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:45.81561+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=13, fields.level=debug, fields.msg="CPU SoftIRQ counter jumped backwards", new_value=16.92, old_value=16.93 2023-07-21T17:16:45.8453+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=20.23 2023-07-21T17:16:45.84586+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:45.86582+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.426059114, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:45.89173+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.071454222, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:45.94679+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:45.9201+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=19.407395663, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:45.99163+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=20.23 2023-07-21T17:16:45.99703+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.239705092, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:46.07285+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:24.66575+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:46.54877+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:45.99672+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.924086858, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:16:24.67243+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:24.87754+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:24.93071+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:16:46.54439+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:45.15625+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:24.98179+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:25.01487+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:25.02221+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T17:16:25.02239+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.934414316, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:16:25.02256+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:24.9894+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:25.02056+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:25.06478+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.602862626, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:25.05164+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.197414732, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:25.04621+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:25.0472+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:25.06944+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:25.06471+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:25.04808+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.066337154, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:25.01843+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:25.01945+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:25.04818+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=18.6 2023-07-21T17:16:25.0202+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:25.06961+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:25.02901+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1216513024e+10 Active_bytes:3.255216128e+10 Active_file_bytes:1.335648256e+09 AnonHugePages_bytes:2.960130048e+10 AnonPages_bytes:3.1216480256e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837305856e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6736458752e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:647168 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.0327552e+08 Inactive_file_bytes:4.85974016e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26808064e+08 MemAvailable_bytes:1.3373145088e+10 MemFree_bytes:1.5742152704e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5788288e+07 SReclaimable_bytes:8.6233088e+07 SUnreclaim_bytes:1.17747712e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.039808e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:28.18658+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.048365675, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:28.19496+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=19.31 2023-07-21T17:16:28.24756+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:16:28.29418+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1220273152e+10 Active_bytes:3.2555905024e+10 Active_file_bytes:1.335631872e+09 AnonHugePages_bytes:2.9615980544e+10 AnonPages_bytes:3.1220875264e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837289472e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6707090432e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:630784 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.0327552e+08 Inactive_file_bytes:4.85974016e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.26799872e+08 MemAvailable_bytes:1.337096192e+10 MemFree_bytes:1.5739977728e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.55712e+07 SReclaimable_bytes:8.6233088e+07 SUnreclaim_bytes:1.17747712e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.039808e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:25.36133+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:16:25.36148+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:16:46.73679+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:46.74364+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:16:49.35396+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:49.69583+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:49.36095+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:49.70374+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.695550697, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:49.37038+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.006966579, err="couldn't get SNTP reply: read udp 127.0.0.1:46239->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:49.34161+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.009460027, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:49.47979+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=29.76 2023-07-21T17:16:49.35282+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:49.34863+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:49.82649+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:49.60947+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1508758528e+10 Active_bytes:3.2844849152e+10 Active_file_bytes:1.336090624e+09 AnonHugePages_bytes:2.9620174848e+10 AnonPages_bytes:3.1509417984e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837760512e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.689897984e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:397312 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03291904e+08 Inactive_file_bytes:4.859904e+08 KernelStack_bytes:2.3773184e+07 Mapped_bytes:1.27225856e+08 MemAvailable_bytes:1.3071085568e+10 MemFree_bytes:1.5439855616e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0912384e+07 SReclaimable_bytes:8.6253568e+07 SUnreclaim_bytes:1.18304768e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04558336e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:50.05927+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:49.34742+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.27273506, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:50.0525+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:50.05206+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:49.37079+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:46.79732+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=22.064378806, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:50.02048+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000756246, err="couldn't get SNTP reply: read udp 127.0.0.1:46748->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:50.0523+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:49.8263+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:50.06735+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:50.07556+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:50.06502+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:48.4769+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:16:50.06621+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:49.94018+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=29.76 2023-07-21T17:16:50.07628+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:50.07489+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:50.08119+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:50.09749+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:50.05406+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.096286657, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:50.07092+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:50.33842+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:50.23354+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:50.10824+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:50.08616+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:50.05876+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=29.76 2023-07-21T17:16:50.72868+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:50.10988+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.249275977, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:50.72191+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:50.07768+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:50.09051+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.024837828, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:50.93042+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:50.71892+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:50.72576+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:50.73132+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=29.76 2023-07-21T17:16:50.73153+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.122717088, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:50.11221+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001431477, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:50.93803+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:51.03785+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:51.18323+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:50.1002+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002577493, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:51.09528+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.073149062, err="couldn't get SNTP reply: read udp 127.0.0.1:16333->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:51.31639+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:51.06367+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:50.95968+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.6633475450000001, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:50.96329+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=29.76 2023-07-21T17:16:50.72686+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:50.97532+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.713899506, err="couldn't get SNTP reply: read udp 127.0.0.1:42899->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:50.73285+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.667330147, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:51.59822+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:51.3236+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.610666699, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:51.34196+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:50.0658+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1509504e+10 Active_bytes:3.2845594624e+10 Active_file_bytes:1.336090624e+09 AnonHugePages_bytes:2.9620174848e+10 AnonPages_bytes:3.1510532096e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837760512e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6898455552e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:397312 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03291904e+08 Inactive_file_bytes:4.859904e+08 KernelStack_bytes:2.3773184e+07 Mapped_bytes:1.27225856e+08 MemAvailable_bytes:1.3070364672e+10 MemFree_bytes:1.543913472e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0912384e+07 SReclaimable_bytes:8.6253568e+07 SUnreclaim_bytes:1.18304768e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04558336e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:50.45464+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1528792064e+10 Active_bytes:3.2864886784e+10 Active_file_bytes:1.33609472e+09 AnonHugePages_bytes:2.9620174848e+10 AnonPages_bytes:3.1529586688e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.8377728e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6908417024e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:409600 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03300096e+08 Inactive_file_bytes:4.85998592e+08 KernelStack_bytes:2.3773184e+07 Mapped_bytes:1.27225856e+08 MemAvailable_bytes:1.3051191296e+10 MemFree_bytes:1.5419953152e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.1272832e+07 SReclaimable_bytes:8.6253568e+07 SUnreclaim_bytes:1.18366208e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04619776e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:51.76409+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=28.207617552, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:28.74109+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:16:28.19557+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:28.95832+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:28.27523+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:28.74095+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:52.24185+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=21.1 2023-07-21T17:16:52.2427+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:52.27846+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:28.76338+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.054737126, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:29.10616+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:52.32045+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.243920325, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:52.28427+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:52.32618+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:52.3277+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:52.32843+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:52.3286+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:52.3291+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=21.1 2023-07-21T17:16:52.33066+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:52.33623+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:52.33635+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:52.33657+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:52.33921+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:52.34224+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:52.34193+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:52.34395+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:52.34398+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=21.1 2023-07-21T17:16:52.34554+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:29.15913+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:29.17003+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.46 2023-07-21T17:16:29.18744+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:52.34638+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:52.35123+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=21.1 2023-07-21T17:16:52.35437+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:52.355+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:52.357+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:52.3572+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:52.35818+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:52.35889+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:52.35894+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:52.36007+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=21.1 2023-07-21T17:16:52.36015+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:52.36897+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:52.43832+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:52.43886+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:52.43909+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:52.43913+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:52.43935+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:52.43952+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:52.443+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:29.24543+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:52.5147+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:29.24839+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.917639402, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:52.51516+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:52.51572+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.507723084, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:52.53287+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.471135557, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:16:52.66806+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:52.74371+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:52.85165+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:52.87975+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=23.301568836, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:52.89062+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:29.95222+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.336131747, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:16:52.88562+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:53.03809+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=34.58 2023-07-21T17:16:52.88069+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1559897088e+10 Active_bytes:3.2896069632e+10 Active_file_bytes:1.336172544e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.155970048e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.837850624e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.69299456e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:466944 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03296e+08 Inactive_file_bytes:4.85994496e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.26963712e+08 MemAvailable_bytes:1.3019615232e+10 MemFree_bytes:1.5388340224e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.1678336e+07 SReclaimable_bytes:8.6253568e+07 SUnreclaim_bytes:1.18464512e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.0471808e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:53.0411+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002581359, err="couldn't get SNTP reply: read udp 127.0.0.1:45546->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:53.04185+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.013845445, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:53.04126+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.013134548, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:53.04161+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:53.04145+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:53.39068+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:53.39778+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:53.41574+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.84 2023-07-21T17:16:53.41697+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:53.41679+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:53.40513+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.195703673, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:53.41667+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:54.17521+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:54.17509+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:54.07568+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:16:54.62316+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:54.17562+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:54.59293+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:54.62427+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001650354, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:54.07503+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000880011, err="couldn't get SNTP reply: read udp 127.0.0.1:21882->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:54.67741+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.84 2023-07-21T17:16:53.46205+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00144238, err="couldn't get SNTP reply: read udp 127.0.0.1:19214->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:54.52179+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:16:54.23026+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=34.58 2023-07-21T17:16:54.68152+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:54.14269+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:54.67868+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:54.68062+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:54.67522+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.148039237, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:16:54.84975+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:16:54.62134+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:54.85451+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:54.99398+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.659214401, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:16:29.40865+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:55.30491+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:55.02757+08:00 WARN [25987,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:16:54.85813+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:29.4337+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:29.19586+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:54.67969+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1601147904e+10 Active_bytes:3.2937517056e+10 Active_file_bytes:1.336369152e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1588130816e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.838137344e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6966125568e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:753664 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03308288e+08 Inactive_file_bytes:4.86006784e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.26967808e+08 MemAvailable_bytes:1.2978368512e+10 MemFree_bytes:1.5346982912e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2010112e+07 SReclaimable_bytes:8.6265856e+07 SUnreclaim_bytes:1.18530048e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04795904e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:55.24205+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1600775168e+10 Active_bytes:3.293714432e+10 Active_file_bytes:1.336369152e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.158757376e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.838137344e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.696560128e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:753664 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03308288e+08 Inactive_file_bytes:4.86006784e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.26967808e+08 MemAvailable_bytes:1.2979154944e+10 MemFree_bytes:1.5347769344e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2010112e+07 SReclaimable_bytes:8.6265856e+07 SUnreclaim_bytes:1.18530048e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04795904e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:55.45896+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:55.5443+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.84 2023-07-21T17:16:55.54828+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:55.48188+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:55.66884+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:55.83955+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.84 2023-07-21T17:16:55.84033+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:55.84028+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.606233071, err="couldn't get SNTP reply: read udp 127.0.0.1:55892->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:55.84197+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:55.89686+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:55.84006+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:55.73249+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:55.92168+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:55.89915+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:56.04497+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:55.94418+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:56.34722+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:56.43344+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:54.85304+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=29.84 2023-07-21T17:16:56.43227+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=34.58 2023-07-21T17:16:56.10095+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:56.55134+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:56.47978+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:56.57544+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:56.49103+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:56.5105+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:56.78331+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:56.491+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:56.57542+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=34.58 2023-07-21T17:16:56.81463+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.481000854, err="couldn't get SNTP reply: read udp 127.0.0.1:31818->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:56.81504+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:16:56.3917+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:56.45682+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:56.33098+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1590694912e+10 Active_bytes:3.292710912e+10 Active_file_bytes:1.336414208e+09 AnonHugePages_bytes:2.9622272e+10 AnonPages_bytes:3.1591006208e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.838153728e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.695413248e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:770048 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03308288e+08 Inactive_file_bytes:4.86006784e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.26967808e+08 MemAvailable_bytes:1.2987297792e+10 MemFree_bytes:1.5355887616e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2509824e+07 SReclaimable_bytes:8.6265856e+07 SUnreclaim_bytes:1.1859968e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04865536e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:16:56.58616+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:56.50849+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:56.76197+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.854060668, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:56.94713+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:56.93242+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:56.67006+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:56.93234+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.056194888, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:57.44846+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=7.265940045, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:16:57.6249+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:32.87347+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:57.71438+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.682221965, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:57.74929+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:32.87178+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:32.89541+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:32.89455+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:32.89207+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:57.76489+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:57.76363+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:32.8989+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:32.91013+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:32.90065+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.022057706, err="couldn't get SNTP reply: read udp 127.0.0.1:61515->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:32.91019+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=27.41 2023-07-21T17:16:33.09038+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.217530261, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:33.09049+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:33.26966+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:33.1862+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:16:33.38095+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:57.7941+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:58.74426+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:16:58.76598+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.536993655, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:16:58.77648+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=39.679511913, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:16:58.86059+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.381807941, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:16:58.7672+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:16:57.94164+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:16:58.77684+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:16:59.24433+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:16:59.27025+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:16:59.29331+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:16:59.3735+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:16:59.37351+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:16:59.27569+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=26.734524987, err="couldn't get SNTP reply: read udp 127.0.0.1:5040->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:16:59.82223+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:03.15621+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:03.15908+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:03.16487+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:03.16131+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00234464, err="couldn't get SNTP reply: read udp 127.0.0.1:61507->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:03.28373+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:03.29718+08:00 WARN [25987,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:03.30358+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:03.30589+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:03.28214+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:08.33404+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:08.2315+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.539657802, err="couldn't get SNTP reply: read udp 127.0.0.1:27080->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:08.33502+08:00 WARN [25987,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:08.34675+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:08.45392+08:00 ERROR [25987,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:08.33453+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.179974331, err="couldn't get SNTP reply: read udp 127.0.0.1:38754->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:08.45347+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.519539113, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:08.75074+08:00 INFO [25987,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=44.31 2023-07-21T17:17:28.16964+08:00 INFO [26106,] caller=sdk/sdk_init.go:43:InitSDK: init sdk conf {ConfigPropertiesDir:conf/config_properties ModuleConfigDir:conf/module_config CryptoPath:conf/.config_secret.key CryptoMethod:plain} 2023-07-21T17:17:28.17063+08:00 INFO [26106,] caller=config/config_reader_writer.go:218:loadYamlFilesFromPath: read config files from path /home/admin/obagent/conf/config_properties 2023-07-21T17:17:28.17107+08:00 INFO [26106,] caller=config/config_reader_writer.go:224:loadYamlFilesFromPath: read config from path /home/admin/obagent/conf/config_properties, files length 2 2023-07-21T17:17:28.17727+08:00 INFO [26106,] caller=config/config_reader_writer.go:218:loadYamlFilesFromPath: read config files from path /home/admin/obagent/conf/module_config 2023-07-21T17:17:28.17775+08:00 INFO [26106,] caller=config/config_reader_writer.go:224:loadYamlFilesFromPath: read config from path /home/admin/obagent/conf/module_config, files length 6 2023-07-21T17:17:28.2958+08:00 INFO [26106,] caller=monagent/main.go:100:runMonitorAgent: sdk inited 2023-07-21T17:17:28.29826+08:00 INFO [26106,] caller=sdk/monagent_callbacks.go:104:func8: module monagent.admin.basic.auth init config sucessfully 2023-07-21T17:17:28.30053+08:00 INFO [26106,] caller=sdk/monagent_callbacks.go:73:func5: module monagent.server.basic.auth init config sucessfully 2023-07-21T17:17:28.3208+08:00 WARN [26106,] caller=engine/pipeline_module_callback.go:115:InitPipelineModuleCallback: pipeline module monitor.mysql is inactive, just skip 2023-07-21T17:17:28.34701+08:00 WARN [26106,] caller=engine/pipeline_module_callback.go:115:InitPipelineModuleCallback: pipeline module monitor.ob.log is inactive, just skip 2023-07-21T17:17:28.35675+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=info, fields.msg="Parsed flag --collector.filesystem.mount-points-exclude", flag="^/(dev|proc|sys|var/lib/docker/.+)($|/)" 2023-07-21T17:17:28.35766+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=info, fields.msg="Parsed flag --collector.filesystem.fs-types-exclude", flag="^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$" 2023-07-21T17:17:28.36377+08:00 INFO [26106,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:HOST svr_ip:172.118.81.152]} 2023-07-21T17:17:28.36457+08:00 INFO [26106,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T17:17:28.36484+08:00 INFO [26106,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/node/host 2023-07-21T17:17:28.36539+08:00 INFO [26106,] caller=engine/pipeline_module_callback.go:33:addPipeline: add pipeline module result succeed 2023-07-21T17:17:28.61004+08:00 INFO [26106,] caller=mysql/table_input.go:144:Init: table input init with config&{0 0xc000121660 map[ob_is_rootservice:false ob_is_v3:false ob_is_v4:false ob_svr_ip:172.118.81.152 ob_svr_port:2882] [0xc000126480 0xc000126500 0xc000126580 0xc000126800 0xc000127180 0xc000127200 0xc000127280 0xc000127300 0xc000127380 0xc000127480 0xc000127500 0xc000127580 0xc000127600 0xc000127680 0xc000127700 0xc000127780] 4} 2023-07-21T17:17:28.61577+08:00 INFO [26106,] caller=mysql/table_input.go:161:Init: successfully init mysql table input plugin 2023-07-21T17:17:28.61713+08:00 INFO [26106,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:OB ob_cluster_id:20230720 ob_cluster_name:obce-3zones obzone:zone2 svr_ip:172.118.81.152]} 2023-07-21T17:17:28.61766+08:00 INFO [26106,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T17:17:28.64452+08:00 INFO [26106,] caller=mysql/table_input.go:144:Init: table input init with config&{0 0xc000121c20 map[ob_is_rootservice:false ob_is_v3:false ob_is_v4:false ob_svr_ip:172.118.81.152 ob_svr_port:2882] [0xc00024a680 0xc00024a700 0xc00024a780 0xc00024a800 0xc00024a880 0xc00024a900 0xc00024a980 0xc00024aa00 0xc00024aa80 0xc00024ab00 0xc00024ab80 0xc00024ac00 0xc00024ac80 0xc00024ad00] 4} 2023-07-21T17:17:28.64962+08:00 INFO [26106,] caller=mysql/table_input.go:161:Init: successfully init mysql table input plugin 2023-07-21T17:17:28.65137+08:00 INFO [26106,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:OB ob_cluster_id:20230720 ob_cluster_name:obce-3zones obzone:zone2 svr_ip:172.118.81.152]} 2023-07-21T17:17:28.65357+08:00 INFO [26106,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T17:17:28.65424+08:00 INFO [26106,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/ob/basic 2023-07-21T17:17:28.65455+08:00 INFO [26106,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/ob/extra 2023-07-21T17:17:28.65481+08:00 INFO [26106,] caller=engine/pipeline_module_callback.go:33:addPipeline: add pipeline module result succeed 2023-07-21T17:17:28.69488+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:28.69636+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:28.69534+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000906425, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:28.69998+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:28.6999+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.23 2023-07-21T17:17:28.69641+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002433118, err="couldn't get SNTP reply: read udp 127.0.0.1:46477->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:28.70129+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=24.98 2023-07-21T17:17:28.70218+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:28.70458+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.009165329, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:28.70478+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:28.70092+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:28.70847+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:28.70428+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.81 2023-07-21T17:17:28.70831+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:28.70902+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:28.70917+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.011452599, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:28.70954+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:17:28.70991+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:17:28.71013+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:28.71039+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:17:28.71054+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.016800797, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:28.70933+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.090546688e+10 Active_bytes:3.2242819072e+10 Active_file_bytes:1.337352192e+09 AnonHugePages_bytes:2.955935744e+10 AnonPages_bytes:3.090589696e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839087616e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.62338304e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:307200 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.0335744e+08 Inactive_file_bytes:4.86055936e+08 KernelStack_bytes:2.3379968e+07 Mapped_bytes:1.24194816e+08 MemAvailable_bytes:1.3689249792e+10 MemFree_bytes:1.6057331712e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.2433664e+07 SReclaimable_bytes:8.630272e+07 SUnreclaim_bytes:1.17932032e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04234752e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:28.71327+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:17:28.71378+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:17:28.71427+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:17:28.71448+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.021182598, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:28.71473+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:17:28.71562+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:17:28.71607+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:17:28.71664+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:17:28.71707+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T17:17:28.71751+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T17:17:28.7179+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T17:17:28.71833+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T17:17:28.71872+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T17:17:28.71917+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T17:17:28.71984+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T17:17:28.72024+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.72084+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.72267+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.017945568, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:28.72279+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T17:17:28.72324+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.72444+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.72449+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T17:17:28.72523+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.72506+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T17:17:28.72553+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.72575+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T17:17:28.72644+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.72685+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.72756+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.72796+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.72867+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.72873+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.032842454, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T17:17:28.72925+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.72984+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.73031+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.73107+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.73149+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.73214+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.73245+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.73289+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.7332+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.73378+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.73414+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.73484+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.73528+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.73605+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.73768+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.73898+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.73932+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.73978+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu21, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.74004+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu21, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.74053+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu22, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.7408+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu22, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.74123+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu23, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.74154+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu23, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.74202+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu3, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.74239+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu3, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.74218+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.04023858, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:17:28.74289+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu4, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.74318+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu4, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.74363+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu5, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.74387+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu5, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.74431+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu6, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.74459+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu6, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.745+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu7, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.74526+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu7, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.7457+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu8, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.74597+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu8, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.74641+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu9, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:28.74668+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu9, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:28.74689+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.053737401, fields.level=debug, fields.msg="collector succeeded", name=cpu 2023-07-21T17:17:28.96414+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:28.96341+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:28.96596+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:28.97225+08:00 INFO [26106,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_partition 2023-07-21T17:17:28.9774+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:28.97737+08:00 INFO [26106,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_partition 2023-07-21T17:17:28.98129+08:00 INFO [26106,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server 2023-07-21T17:17:28.98377+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:28.98291+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:28.98853+08:00 INFO [26106,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server 2023-07-21T17:17:29.06825+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) QUERY_TIMEOUT(100000000) */ tenant_name, 1 as role, case when cnt is null then 0 else cnt end as cnt from (select __all_tenant.tenant_name, t1.cnt from __all_tenant left join (select tenant_id, count(*) as cnt from __all_virtual_partition_info where svr_ip = ? and svr_port = ? group by tenant_id) t1 on __all_tenant.tenant_id = t1.tenant_id) t2 2023-07-21T17:17:29.24998+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:29.25058+08:00 WARN [26106,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T17:17:29.31701+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ group_concat(svr_ip SEPARATOR ',') as servers, status, count(1) as cnt from __all_server group by status 2023-07-21T17:17:29.33509+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:17:29.37371+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:17:29.37779+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:29.6369+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:29.65031+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:29.65877+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:29.6652+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:29.67416+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:29.67533+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:29.68377+08:00 INFO [26106,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_disk 2023-07-21T17:17:29.76855+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:17:29.86729+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:17:29.89632+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:29.90985+08:00 INFO [26106,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T17:17:29.91133+08:00 INFO [26106,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T17:17:29.91774+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001134151, err="couldn't get SNTP reply: read udp 127.0.0.1:33082->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:29.97616+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ cpu_total,cpu_assigned,mem_total,mem_assigned,disk_total,disk_assigned,unit_num,migrating_unit_num,cpu_assigned_percent, mem_assigned_percent, disk_assigned_percent from __all_virtual_server_stat where svr_ip = ? and svr_port = ? 2023-07-21T17:17:30.22439+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.268722687, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:30.22273+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:30.34764+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:30.55184+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:30.66765+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:30.12471+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.0959362048e+10 Active_bytes:3.229677568e+10 Active_file_bytes:1.337413632e+09 AnonHugePages_bytes:2.9571940352e+10 AnonPages_bytes:3.0956007424e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839140864e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6544192512e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:360448 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03341056e+08 Inactive_file_bytes:4.86039552e+08 KernelStack_bytes:2.3576576e+07 Mapped_bytes:1.26418944e+08 MemAvailable_bytes:1.3634863104e+10 MemFree_bytes:1.6002920448e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.3056256e+07 SReclaimable_bytes:8.630272e+07 SUnreclaim_bytes:1.1792384e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.0422656e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:30.67162+08:00 INFO [26106,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_disk 2023-07-21T17:17:30.64828+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.23 2023-07-21T17:17:30.66595+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:30.67235+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=24.98 2023-07-21T17:17:30.67295+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:30.67357+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:30.67398+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:17:30.67446+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:17:30.67297+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.81 2023-07-21T17:17:30.68781+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:30.7311+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ total_size, free_size from __all_virtual_disk_stat where svr_ip = ? and svr_port = ? 2023-07-21T17:17:30.67863+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:17:30.2364+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:30.68803+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.446213492, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:30.83533+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:30.83645+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:30.85925+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.093059853, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:30.87019+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:30.88183+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:17:30.92944+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:30.93077+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:30.95177+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:17:30.95257+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:17:30.95322+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:17:30.95366+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:17:30.95407+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:17:30.95448+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:17:30.95484+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:17:30.95547+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T17:17:30.95584+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T17:17:30.95622+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T17:17:30.95676+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T17:17:30.95714+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T17:17:30.95756+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T17:17:31.00293+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:17:30.99729+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:31.01644+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:31.01748+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:30.95787+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T17:17:31.01838+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T17:17:30.67234+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.756219831, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:31.01798+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:31.06295+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T17:17:30.99779+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:31.57634+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000621424, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:31.36125+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.126177479, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:31.60263+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T17:17:31.6388+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:17:31.6393+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:17:31.58767+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:31.64415+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:31.6451+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:31.64598+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:31.64638+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:31.648+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:31.64835+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:31.64896+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:31.64932+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:31.6505+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:31.01866+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:31.65088+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:31.59987+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.076160034, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:31.65268+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:31.65287+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:17:31.65317+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:31.6529+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:31.65377+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:31.65412+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:31.65464+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:31.655+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:31.65584+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:31.65646+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:31.65167+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:31.66384+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:31.66634+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:17:31.66628+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T17:17:31.6664+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:31.63845+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:17:31.6387+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:17:31.67239+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:31.67683+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:17:31.72272+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:31.67659+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:31.7252+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.047897265, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:31.68475+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:31.84081+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:17:31.67935+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:17:31.71631+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:32.18486+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.489599402, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:32.19527+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:32.13422+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:32.1961+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:32.19695+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:32.19956+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:17:32.20032+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:17:32.20082+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:17:31.94+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:32.21685+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:17:31.84484+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:32.33397+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:32.33544+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:32.33601+08:00 WARN [26106,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T17:17:32.33795+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:32.41027+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:32.41792+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:17:31.84328+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.23 2023-07-21T17:17:31.67724+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:32.42799+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:32.65089+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:32.65239+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:32.65297+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:32.65373+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:32.65432+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:32.6844+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu21, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:32.74584+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:32.74621+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:32.74827+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:32.75319+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:32.76634+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.831578548, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T17:17:32.76692+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:32.7681+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:32.74841+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000965729, err="couldn't get SNTP reply: read udp 127.0.0.1:56412->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:31.94179+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:17:32.77348+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:32.7807+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:32.7824+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:32.7829+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:32.78366+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.045996711, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:32.78542+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.221250764, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:32.7545+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:32.79004+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:32.88997+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:32.89022+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:32.89033+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.116922413, err="couldn't get SNTP reply: read udp 127.0.0.1:64553->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:32.78406+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1012933632e+10 Active_bytes:3.2350449664e+10 Active_file_bytes:1.337516032e+09 AnonHugePages_bytes:2.959081472e+10 AnonPages_bytes:3.1011119104e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839251456e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.661246464e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:344064 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03345152e+08 Inactive_file_bytes:4.86043648e+08 KernelStack_bytes:2.3691264e+07 Mapped_bytes:1.26582784e+08 MemAvailable_bytes:1.3577744384e+10 MemFree_bytes:1.5945752576e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.3854976e+07 SReclaimable_bytes:8.6294528e+07 SUnreclaim_bytes:1.17948416e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04242944e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:32.77477+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:32.89054+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:32.89168+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:32.89151+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:32.89068+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:32.97797+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.233365621, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:32.99603+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:32.99673+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:32.95577+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:31.958+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:17:33.00127+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.038877046, err="couldn't get SNTP reply: read udp 127.0.0.1:35423->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:33.08627+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:31.95779+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.23 2023-07-21T17:17:33.19789+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:33.1917+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:33.0876+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:17:33.12695+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:33.28032+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:33.28044+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.102567, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:33.28106+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:33.28193+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:33.2825+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:17:33.28255+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:33.28317+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:17:33.28397+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:17:33.28456+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:17:33.17009+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:33.28017+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:17:33.45279+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:17:33.45261+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:33.45235+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:17:33.45335+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:17:33.28107+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.284323056, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:33.2817+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:33.51785+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:17:33.46867+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:17:33.57757+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:33.09533+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:17:33.63767+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:33.63838+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:33.63969+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:33.63879+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.61 2023-07-21T17:17:33.63891+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:33.63902+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=24.98 2023-07-21T17:17:33.64136+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.01726997, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:33.6403+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:33.64268+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:33.6438+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:33.64424+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.81 2023-07-21T17:17:33.64092+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=24.86 2023-07-21T17:17:33.64482+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.74 2023-07-21T17:17:33.64533+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.007057599, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:33.64435+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:33.64988+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.8818978629999998, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:33.65039+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.564368344, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:33.65599+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:17:33.65675+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:33.65709+08:00 WARN [26106,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T17:17:33.67121+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:33.67181+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:32.00262+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:33.67396+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:17:32.64226+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:33.67416+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:33.6825+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.6648834839999997, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:31.94247+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:33.68427+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=24.98 2023-07-21T17:17:33.72199+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.81 2023-07-21T17:17:33.72226+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:33.72285+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.879927462, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:32.64866+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:33.72542+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:17:33.72321+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:33.76632+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:17:33.76683+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:17:33.76731+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:17:33.72268+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:17:33.77025+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:17:33.77096+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:17:33.77114+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:17:33.77169+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:17:33.72323+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:17:33.77403+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:17:33.77856+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:17:33.77072+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:33.77394+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:17:33.7934+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:17:33.79408+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:17:33.79457+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:17:33.77863+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:17:33.79783+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:33.79831+08:00 WARN [26106,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T17:17:32.6421+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:33.81655+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu21, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:33.81764+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu22, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:33.81818+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu22, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:33.81895+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu23, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:33.81946+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu23, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:33.81739+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.751799449, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:33.82299+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:17:33.82282+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu3, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:33.82424+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu3, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:33.82436+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:33.82521+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu4, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:33.8257+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu4, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:33.82666+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu5, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:33.82716+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu5, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:33.82772+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu6, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:33.8284+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu6, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:33.82914+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu7, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:33.82969+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu7, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:33.91349+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu8, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:33.91396+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu8, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:33.91454+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu9, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:33.91492+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu9, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:17:33.77874+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:17:33.91639+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.0003137, fields.level=debug, fields.msg="collector succeeded", name=cpu 2023-07-21T17:17:33.77234+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:17:33.92947+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:17:33.93+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:17:33.93049+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:17:33.93123+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T17:17:33.93278+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T17:17:33.93329+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T17:17:33.93371+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T17:17:33.93433+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T17:17:33.77922+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:33.79534+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:17:33.99972+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:17:34.00029+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:17:33.77905+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:17:34.00082+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T17:17:34.01206+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T17:17:34.01252+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T17:17:34.01298+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T17:17:34.01356+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T17:17:33.92651+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:34.01405+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T17:17:34.0146+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T17:17:33.93496+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T17:17:34.01572+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T17:17:34.01709+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:34.01548+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T17:17:34.0224+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T17:17:34.02288+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T17:17:34.02333+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T17:17:34.16932+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T17:17:34.17556+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:34.17562+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:17:34.17607+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:17:34.17661+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T17:17:34.18757+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:34.18463+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:34.19435+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:34.29302+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T17:17:34.25048+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:17:34.2646+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:34.17624+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:17:34.29377+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T17:17:34.25702+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:34.38239+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:34.47402+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:17:34.48147+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:34.47913+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:17:34.29406+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:17:34.38259+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.705837827, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T17:17:34.29516+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:34.29414+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:34.48208+08:00 WARN [26106,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T17:17:34.48249+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:34.48104+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:34.43407+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:34.5645+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:17:34.76203+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:17:34.88479+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:35.33194+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:17:34.92572+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.248742616, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T17:17:34.87254+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:17:35.24021+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:17:35.33766+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.61 2023-07-21T17:17:34.8758+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:17:35.32725+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.28261443, err="couldn't get SNTP reply: read udp 127.0.0.1:62775->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:35.87649+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:35.25633+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:17:35.88445+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:17:35.88874+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:17:35.88533+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:17:35.89015+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:17:34.72033+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:17:35.83597+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:17:35.8725+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:17:35.88227+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:17:35.89975+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=24.86 2023-07-21T17:17:34.73192+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:35.88256+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:17:34.69534+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:35.87556+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1055454208e+10 Active_bytes:3.2393007104e+10 Active_file_bytes:1.337552896e+09 AnonHugePages_bytes:2.9592911872e+10 AnonPages_bytes:3.1058751488e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839276032e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6641107968e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:368640 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03345152e+08 Inactive_file_bytes:4.86043648e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26623744e+08 MemAvailable_bytes:1.3536022528e+10 MemFree_bytes:1.5904014336e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4108928e+07 SReclaimable_bytes:8.6294528e+07 SUnreclaim_bytes:1.17940224e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04234752e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:35.94837+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:36.09101+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:35.94902+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:36.3949+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:17:36.54003+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:36.06625+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:36.6619+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.74 2023-07-21T17:17:36.55354+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:17:36.4073+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:35.90585+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.856060689, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:35.90429+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1023710208e+10 Active_bytes:3.236122624e+10 Active_file_bytes:1.337516032e+09 AnonHugePages_bytes:2.959081472e+10 AnonPages_bytes:3.1022260224e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839251456e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6635541504e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:344064 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03345152e+08 Inactive_file_bytes:4.86043648e+08 KernelStack_bytes:2.3691264e+07 Mapped_bytes:1.26582784e+08 MemAvailable_bytes:1.356773376e+10 MemFree_bytes:1.5935741952e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.3854976e+07 SReclaimable_bytes:8.6294528e+07 SUnreclaim_bytes:1.17948416e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04242944e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:36.50188+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:36.50199+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:36.65316+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:17:36.5607+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:36.70662+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:36.59134+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:36.69429+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:17:36.69452+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:17:36.40723+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:36.69462+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:36.84691+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:36.69339+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.375943728, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:36.8372+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1071760384e+10 Active_bytes:3.2409366528e+10 Active_file_bytes:1.337606144e+09 AnonHugePages_bytes:2.959081472e+10 AnonPages_bytes:3.1063814144e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839337472e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6650446848e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:430080 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03345152e+08 Inactive_file_bytes:4.86043648e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26681088e+08 MemAvailable_bytes:1.351856128e+10 MemFree_bytes:1.5886524416e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4162176e+07 SReclaimable_bytes:8.6294528e+07 SUnreclaim_bytes:1.17940224e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04234752e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:37.23461+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.505785811, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:37.26483+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:37.71894+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.790091735, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:37.708+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:37.70796+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:37.92366+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:37.90327+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:17:37.92469+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:37.2883+08:00 WARN [26106,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T17:17:37.92582+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.875070946, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:37.30627+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.080715018, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:37.9859+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:17:37.98125+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:37.70861+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:38.0813+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:38.08204+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:38.08292+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:38.09267+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:38.17909+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:38.19038+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:17:38.20623+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:38.20645+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:38.21665+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:17:38.21671+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:38.21894+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:17:38.2197+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:17:38.31603+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:38.25101+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.32 2023-07-21T17:17:38.22563+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.143020555, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:38.22058+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:17:38.39223+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:17:38.38021+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:17:38.3585+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:38.56128+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:38.56143+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:38.59189+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:38.59368+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:38.79281+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:38.76084+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:38.79268+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:38.78933+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:38.79407+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:17:38.66018+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:38.86832+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:38.65373+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:38.86868+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:38.99795+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.41 2023-07-21T17:17:39.28076+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:39.35186+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:39.28434+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:17:39.36061+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:17:39.32617+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:17:39.36671+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:39.1636+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:39.63375+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.172623563, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:39.6354+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:39.6445+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:17:39.61483+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:17:39.84925+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:17:39.84898+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:39.73424+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:17:39.85131+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.192888595, err="couldn't get SNTP reply: read udp 127.0.0.1:51956->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:39.90184+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:39.91293+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:40.1413+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:17:40.39793+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:40.76367+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:40.82537+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:40.85227+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.756824482, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:39.28064+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:17:40.1312+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:17:39.85112+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:17:42.82597+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:17:39.84862+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:40.99948+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:39.13096+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:41.35316+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:17:43.01553+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:17:41.46548+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:17:43.01055+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:43.00371+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:17:42.7457+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.82 2023-07-21T17:17:43.01123+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:17:43.20089+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.89 2023-07-21T17:17:41.24062+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.481320314, err="couldn't get SNTP reply: read udp 127.0.0.1:38844->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:41.24079+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:43.05976+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:42.82751+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:42.27435+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:17:42.27482+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:42.47564+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:42.55775+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:42.55174+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:42.50188+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:42.26984+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:42.65773+08:00 ERROR [26106,] caller=engine/route_manager.go:173:pull: failed to write http response from buffer fields: error="write tcp 172.118.81.152:8088->172.118.81.152:17610: write: broken pipe" 2023-07-21T17:17:43.22206+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:42.43831+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:41.3497+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.927758131, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:43.22892+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:17:43.46882+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:17:43.49604+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:43.24719+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:43.22839+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:17:43.50054+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:42.47851+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.1294265, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:43.49615+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:17:43.61855+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:17:43.49665+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:43.50295+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.306726519, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:17:43.55277+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.084941466, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:43.82824+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:43.82847+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.62409815, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:43.8039+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:43.82052+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.94 2023-07-21T17:17:43.79883+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:43.96951+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:43.83518+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:43.97387+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.03 2023-07-21T17:17:43.97469+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.566245543, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:43.97796+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:43.97881+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:43.97927+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:44.04147+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:43.9699+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:43.97014+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:44.05931+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:17:43.82739+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:17:44.09474+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:44.19063+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:44.18596+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:17:44.21256+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:44.20931+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:17:44.21663+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:17:44.32828+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:17:44.42431+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:17:44.21833+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:44.45153+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:17:44.4873+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:44.38496+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:44.48872+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.103657852, err="couldn't get SNTP reply: read udp 127.0.0.1:59365->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:44.52435+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:17:44.52439+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:17:44.52718+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.003092493, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:43.98022+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:44.53142+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:17:44.53296+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:44.53586+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:44.53645+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.641297087, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:44.53875+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:17:44.53846+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:44.54002+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:17:44.55964+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:44.55924+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:44.55936+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:44.56193+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:44.58333+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.82 2023-07-21T17:17:44.76371+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:41.91274+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:44.76395+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.94 2023-07-21T17:17:41.89541+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:44.70502+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:44.76467+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:44.76449+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:44.80672+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.03 2023-07-21T17:17:44.91063+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:44.93294+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.385162248, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:44.9334+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:44.76949+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:44.95367+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:44.9594+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:44.95884+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:44.96187+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:44.96098+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.02725+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.05435+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:45.05428+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.03056+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.471622734, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:45.05853+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.05953+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.149982989, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:45.09116+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:44.76756+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:17:45.09658+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:17:45.09802+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:17:45.09944+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:17:45.10095+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T17:17:45.10197+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T17:17:45.04275+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.1029+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T17:17:45.10347+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T17:17:45.10405+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.489438424, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:45.10405+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T17:17:45.10525+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T17:17:41.87809+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1112290304e+10 Active_bytes:3.2450019328e+10 Active_file_bytes:1.337729024e+09 AnonHugePages_bytes:2.9597106176e+10 AnonPages_bytes:3.1111135232e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839480832e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.666710528e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:593920 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03369728e+08 Inactive_file_bytes:4.86068224e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26808064e+08 MemAvailable_bytes:1.3475872768e+10 MemFree_bytes:1.584375808e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4887168e+07 SReclaimable_bytes:8.6298624e+07 SUnreclaim_bytes:1.17940224e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04238848e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:45.11637+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.11648+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000969423, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:45.11319+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.117529088e+10 Active_bytes:3.2513077248e+10 Active_file_bytes:1.337786368e+09 AnonHugePages_bytes:2.9620174848e+10 AnonPages_bytes:3.118798848e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839529984e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.66987264e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:643072 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03365632e+08 Inactive_file_bytes:4.86064128e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26857216e+08 MemAvailable_bytes:1.3412020224e+10 MemFree_bytes:1.577988096e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5825152e+07 SReclaimable_bytes:8.630272e+07 SUnreclaim_bytes:1.17997568e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04300288e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:45.11854+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.292802438, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:45.11899+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.12142+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.12195+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.029590262, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:45.12231+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.11706+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T17:17:45.12335+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.12159+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:45.12869+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000954494, err="couldn't get SNTP reply: read udp 127.0.0.1:64790->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:45.13058+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000667344, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:45.13187+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:45.12416+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.1379+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T17:17:45.13892+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T17:17:45.1388+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000702058, err="couldn't get SNTP reply: read udp 127.0.0.1:10683->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:45.14128+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T17:17:45.14236+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T17:17:45.14369+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.003560826, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:45.14822+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:45.14926+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:45.15067+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:45.15192+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:17:45.15303+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:17:45.1545+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:17:45.15663+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.003894529, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:45.16201+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:45.16195+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000511129, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:45.16308+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.82 2023-07-21T17:17:45.16725+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.94 2023-07-21T17:17:45.13678+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.13885+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:45.136+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.51087+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.82 2023-07-21T17:17:45.51556+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.127670133, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:45.54471+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:45.16196+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:45.60672+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.15263+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.019998768, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:45.51135+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.82 2023-07-21T17:17:45.7617+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:45.76757+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.94 2023-07-21T17:17:45.76775+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.245452192, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:45.76791+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002442918, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:45.77118+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.03 2023-07-21T17:17:45.81146+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:45.8114+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:45.55586+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.94 2023-07-21T17:17:45.81715+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:45.77192+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:45.81558+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:45.82093+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:45.70762+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:45.60844+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:45.82787+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.004849556, err="couldn't get SNTP reply: read udp 127.0.0.1:51894->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:45.70758+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:45.96199+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:45.97527+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1187591168e+10 Active_bytes:3.2525377536e+10 Active_file_bytes:1.337786368e+09 AnonHugePages_bytes:2.9620174848e+10 AnonPages_bytes:3.1198015488e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839529984e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6705542144e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:643072 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03365632e+08 Inactive_file_bytes:4.86064128e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26857216e+08 MemAvailable_bytes:1.339904e+10 MemFree_bytes:1.5766900736e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5825152e+07 SReclaimable_bytes:8.630272e+07 SUnreclaim_bytes:1.17997568e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04300288e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:45.96236+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.82 2023-07-21T17:17:46.05516+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:46.06353+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:45.16878+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.03 2023-07-21T17:17:46.05502+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.94 2023-07-21T17:17:46.05474+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:46.29414+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:46.4017+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.03 2023-07-21T17:17:46.40274+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.234238027, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:46.43541+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.064948089, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:46.56244+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:46.56252+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:46.56285+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.82 2023-07-21T17:17:46.35554+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:46.15028+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.98595331, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:46.15254+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:45.22044+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:45.21914+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:46.75255+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:46.75253+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.94 2023-07-21T17:17:45.21791+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:46.85322+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:46.75858+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:46.84061+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.03 2023-07-21T17:17:46.75256+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:46.64159+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:45.22114+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:46.80054+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:46.75929+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:46.80379+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.82 2023-07-21T17:17:46.85605+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:47.02625+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.057293037, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:47.02793+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:47.04581+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:47.1182+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:47.11802+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:47.12015+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:47.22417+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:46.86477+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:46.8666+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.293699824, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:47.23918+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.286058415, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:47.12023+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:47.12115+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:47.24875+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.94 2023-07-21T17:17:47.39701+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:47.25491+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:47.41384+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.132488363, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:47.4478+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:47.49135+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:46.96914+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:47.55609+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:46.97245+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1206141952e+10 Active_bytes:3.2543952896e+10 Active_file_bytes:1.337810944e+09 AnonHugePages_bytes:2.9609689088e+10 AnonPages_bytes:3.1206354944e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839558656e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6712357888e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:671744 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03369728e+08 Inactive_file_bytes:4.86068224e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26865408e+08 MemAvailable_bytes:1.3379047424e+10 MemFree_bytes:1.5746891776e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.6722176e+07 SReclaimable_bytes:8.630272e+07 SUnreclaim_bytes:1.18022144e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04324864e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:47.22844+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:17:47.9739+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:47.95471+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001788867, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:47.97414+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.03 2023-07-21T17:17:47.95856+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:47.92987+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:47.92636+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:47.98274+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:47.98916+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:47.952+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:48.00259+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:47.94167+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1211732992e+10 Active_bytes:3.2549543936e+10 Active_file_bytes:1.337810944e+09 AnonHugePages_bytes:2.9609689088e+10 AnonPages_bytes:3.1213596672e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839558656e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.671445504e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:671744 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03369728e+08 Inactive_file_bytes:4.86068224e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26865408e+08 MemAvailable_bytes:1.3372653568e+10 MemFree_bytes:1.574049792e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.6722176e+07 SReclaimable_bytes:8.630272e+07 SUnreclaim_bytes:1.18022144e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04324864e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:47.98918+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:47.99068+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:17:47.99679+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.03969+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.201274155, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:48.04104+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:17:48.0398+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.04055+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.819571314, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:48.10486+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.09381+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:17:48.10657+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.256058544, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:48.09425+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.07865+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:48.11218+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:17:48.10901+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=37.35 2023-07-21T17:17:48.1134+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.11324+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.11377+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.11537+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.11116+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.11502+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.11586+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.1176+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.11826+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.11824+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:48.11832+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.12005+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.12045+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:48.12074+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.12178+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.1209+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.12203+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000931325, err="couldn't get SNTP reply: read udp 127.0.0.1:27815->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:48.12257+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.12314+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.12463+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:48.12518+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.004452315, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:48.13592+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.423696333, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:48.1637+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.254663472, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:48.17995+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.044726256, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:48.33886+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:48.4409+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:48.44204+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:48.44232+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:48.51015+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:48.45301+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:48.5246+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:17:48.61175+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:48.64501+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:48.44056+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:48.58874+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:17:48.44057+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:48.44072+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:37.23809+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:48.68708+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:17:48.70799+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:48.81255+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:48.44053+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:48.86997+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:48.7085+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:17:48.70165+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:17:48.93547+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:48.81405+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1247540224e+10 Active_bytes:3.2585392128e+10 Active_file_bytes:1.337851904e+09 AnonHugePages_bytes:2.9609689088e+10 AnonPages_bytes:3.124891648e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.83965696e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6732444672e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:720896 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7313792e+07 Inactive_bytes:5.03382016e+08 Inactive_file_bytes:4.86068224e+08 KernelStack_bytes:2.3822336e+07 Mapped_bytes:1.28438272e+08 MemAvailable_bytes:1.333323776e+10 MemFree_bytes:1.5701057536e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.89504e+07 SReclaimable_bytes:8.6306816e+07 SUnreclaim_bytes:1.18349824e+08 Shmem_bytes:1.7870848e+07 Slab_bytes:2.0465664e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:48.93938+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:17:48.93979+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=37.35 2023-07-21T17:17:48.94113+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.66 2023-07-21T17:17:48.93561+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T17:17:48.94416+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:49.24578+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T17:17:49.24844+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T17:17:49.25571+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T17:17:49.25581+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:49.25704+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T17:17:49.03145+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=37.35 2023-07-21T17:17:48.94278+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:17:49.25724+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:49.25738+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:49.39363+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:49.25766+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:49.3632+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=37.35 2023-07-21T17:17:48.94369+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.749369669, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:49.25824+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.013962582, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:49.45605+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.66 2023-07-21T17:17:49.69666+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.91 2023-07-21T17:17:49.69724+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.667118412, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:49.74467+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:49.6946+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:49.24636+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=9.387938788, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:49.80321+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:49.25803+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.146548173, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:49.40226+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:17:49.25637+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.011290268, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:48.94467+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:49.24401+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.91 2023-07-21T17:17:49.80508+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:49.83944+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:49.85094+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.038266443, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:49.85063+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:49.92814+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:49.84217+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:49.92921+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:49.93613+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:49.93642+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:49.93726+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:49.93814+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:17:49.93839+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:49.85276+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.66 2023-07-21T17:17:49.25831+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T17:17:49.84987+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:50.00092+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.111369725, err="couldn't get SNTP reply: read udp 127.0.0.1:32361->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:49.80515+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:49.95175+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1090102272e+10 Active_bytes:3.2427798528e+10 Active_file_bytes:1.337696256e+09 AnonHugePages_bytes:2.9595009024e+10 AnonPages_bytes:3.1089963008e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839456256e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6658192384e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:565248 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03365632e+08 Inactive_file_bytes:4.86064128e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26734336e+08 MemAvailable_bytes:1.3496758272e+10 MemFree_bytes:1.5864664064e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4596352e+07 SReclaimable_bytes:8.6298624e+07 SUnreclaim_bytes:1.17932032e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04230656e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:50.00594+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:49.99224+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000331768, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:49.9987+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:17:50.39659+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T17:17:50.39904+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.754472029, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:50.17261+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:17:50.43599+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:50.47022+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.535524639, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:49.93922+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:49.95307+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.91 2023-07-21T17:17:50.48565+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.252067343, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:50.36598+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:50.51146+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:17:50.47215+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:49.36295+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:50.86386+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:50.51541+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.003267613, err="couldn't get SNTP reply: read udp 127.0.0.1:6856->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:50.94024+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.719987976, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:50.51642+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:50.78928+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:50.94152+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:50.51632+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:17:50.94256+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:50.94614+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:50.94733+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:50.76398+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:50.43667+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=17.131296042, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:50.6368+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:50.68254+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:50.94225+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T17:17:50.51719+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:50.8758+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:50.94855+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.01616+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:50.94374+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:17:50.94331+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:50.94329+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.485723575, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:50.94422+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.133005165, err="couldn't get SNTP reply: read udp 127.0.0.1:59284->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:51.01656+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:51.31059+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T17:17:50.94505+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=37.35 2023-07-21T17:17:50.95901+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.247441796, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:51.48466+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.66 2023-07-21T17:17:51.46918+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:17:51.47189+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:17:51.47304+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:51.4837+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.48345+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.4905+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T17:17:51.49624+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:17:51.49465+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.91 2023-07-21T17:17:51.49623+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.49627+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:51.4971+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.50124+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.988005832, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:51.50837+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T17:17:51.50888+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:51.50879+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T17:17:51.51843+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.52317+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.476870984, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:51.5367+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T17:17:51.53664+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.67305+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T17:17:51.67492+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T17:17:51.67948+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.68267+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T17:17:51.68384+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T17:17:51.68522+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T17:17:51.68509+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.835012734, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:51.78605+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:51.78558+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=37.35 2023-07-21T17:17:51.78657+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:51.83643+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T17:17:51.78667+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.66 2023-07-21T17:17:51.88113+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.91 2023-07-21T17:17:51.83756+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T17:17:51.83748+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=37.35 2023-07-21T17:17:51.89241+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.66 2023-07-21T17:17:51.88882+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T17:17:51.8947+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T17:17:51.89429+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.91 2023-07-21T17:17:41.49549+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.32 2023-07-21T17:17:51.89579+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.134548308, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:51.89705+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:51.87248+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.111226581, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:51.90997+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.772472455, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T17:17:51.93778+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.88838+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.102006688, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:51.94225+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.94291+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.94851+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=13.140868407, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:51.94723+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:52.03604+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.89626+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.41 2023-07-21T17:17:51.94766+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:52.09908+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:52.11122+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.032375557, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:52.20776+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:51.88593+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.404191307, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:41.67498+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:52.32264+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.013007449, err="couldn't get SNTP reply: read udp 127.0.0.1:12055->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:52.45318+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:52.46416+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:52.45309+08:00 WARN [26106,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T17:17:52.09863+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.89 2023-07-21T17:17:52.47407+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.237355201, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:52.47534+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:52.49085+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:52.5835+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:52.58565+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:52.11102+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:52.63519+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:41.56362+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:52.71829+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:52.72106+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.84076475, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:52.74959+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.134051586, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:52.75313+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:52.45289+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:52.37587+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.93817+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.109482496e+10 Active_bytes:3.2432545792e+10 Active_file_bytes:1.337720832e+09 AnonHugePages_bytes:2.9597106176e+10 AnonPages_bytes:3.1097257984e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839464448e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6660289536e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:577536 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03365632e+08 Inactive_file_bytes:4.86064128e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26799872e+08 MemAvailable_bytes:1.3493661696e+10 MemFree_bytes:1.58615552e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4727424e+07 SReclaimable_bytes:8.6298624e+07 SUnreclaim_bytes:1.17940224e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04238848e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:41.56361+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:53.0571+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:52.76347+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:41.78437+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:52.35454+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:41.8+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:52.63932+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.04 2023-07-21T17:17:53.1133+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:52.66423+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:52.88239+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:52.63467+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:17:53.19362+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.258238327, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:53.11385+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.99 2023-07-21T17:17:52.92724+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.150930987, err="couldn't get SNTP reply: read udp 127.0.0.1:39997->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:41.70779+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:17:52.92733+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:53.3072+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:53.0528+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:40.96988+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:17:53.35205+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:53.39501+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=12.66068693, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:52.76405+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:52.9295+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:53.30605+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.99 2023-07-21T17:17:53.42307+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.872588118, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:17:41.78521+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:17:53.46862+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:53.46957+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:52.76497+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:53.46985+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:53.48925+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.011550908, err="couldn't get SNTP reply: read udp 127.0.0.1:50967->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:40.98695+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:54.00755+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1305732096e+10 Active_bytes:3.2643670016e+10 Active_file_bytes:1.33793792e+09 AnonHugePages_bytes:2.9615980544e+10 AnonPages_bytes:3.13068544e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839693824e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6768256e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:475136 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03365632e+08 Inactive_file_bytes:4.86064128e+08 KernelStack_bytes:2.37568e+07 Mapped_bytes:1.26967808e+08 MemAvailable_bytes:1.3274165248e+10 MemFree_bytes:1.5641935872e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.856128e+07 SReclaimable_bytes:8.63232e+07 SUnreclaim_bytes:1.18513664e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04836864e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:53.46993+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:54.04401+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:54.04477+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:17:54.04536+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:17:54.0958+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:53.54771+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:41.82576+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:54.54054+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:17:54.58838+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.909991038, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:54.59253+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:54.6121+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:54.19132+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.487772474, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:52.88213+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:17:54.18409+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:41.78514+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:17:52.9264+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:53.47027+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:52.9269+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:17:52.88224+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.04 2023-07-21T17:17:52.91263+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:52.72383+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:53.52102+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.595374192, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:54.07386+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:17:53.49549+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:54.66815+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, err="no such file or directory", fields.level=debug, fields.msg="Error on statfs() system call", rootfs=/run/user/0 2023-07-21T17:17:53.3067+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:53.52096+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:53.30794+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:54.86438+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1330988032e+10 Active_bytes:3.266895872e+10 Active_file_bytes:1.337970688e+09 AnonHugePages_bytes:2.9624369152e+10 AnonPages_bytes:3.1331090432e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.8397184e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.67813632e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:499712 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03369728e+08 Inactive_file_bytes:4.86068224e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.2695552e+08 MemAvailable_bytes:1.3250740224e+10 MemFree_bytes:1.5618494464e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.856128e+07 SReclaimable_bytes:8.63232e+07 SUnreclaim_bytes:1.18513664e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04836864e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:56.14959+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:52.91107+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1296765952e+10 Active_bytes:3.2634703872e+10 Active_file_bytes:1.33793792e+09 AnonHugePages_bytes:2.9615980544e+10 AnonPages_bytes:3.1296827392e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839693824e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6762677248e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:475136 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03365632e+08 Inactive_file_bytes:4.86064128e+08 KernelStack_bytes:2.37568e+07 Mapped_bytes:1.26967808e+08 MemAvailable_bytes:1.3285228544e+10 MemFree_bytes:1.5652999168e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.856128e+07 SReclaimable_bytes:8.63232e+07 SUnreclaim_bytes:1.18513664e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04836864e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:53.70863+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:54.8813+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:54.05144+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:17:53.47738+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.006952726, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:53.97107+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:54.84054+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:54.69513+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:54.8473+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:54.94024+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:54.84104+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:55.12149+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:55.10893+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.865087276, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:55.1094+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.04 2023-07-21T17:17:55.08614+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:54.88092+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.431870584, err="couldn't get SNTP reply: read udp 127.0.0.1:6469->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:55.40726+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:55.30436+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.7654789929999999, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:55.5431+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:55.53287+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:17:55.53257+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:55.53525+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.328191961, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:55.66898+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:54.88081+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:56.14288+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:56.09656+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:55.86443+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:55.87219+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:56.13901+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:56.15566+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:55.87228+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:56.21112+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:55.21853+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:55.8776+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.04 2023-07-21T17:17:55.87825+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:55.87184+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:55.8746+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:56.15589+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:56.14291+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:55.82128+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:55.92397+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:56.21306+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.301625901, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:17:56.14134+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1337771008e+10 Active_bytes:3.2675741696e+10 Active_file_bytes:1.337970688e+09 AnonHugePages_bytes:2.9624369152e+10 AnonPages_bytes:3.1338483712e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.8397184e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6782411776e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:499712 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.03373824e+08 Inactive_file_bytes:4.86068224e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.2695552e+08 MemAvailable_bytes:1.3244317696e+10 MemFree_bytes:1.5612071936e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.856128e+07 SReclaimable_bytes:8.63232e+07 SUnreclaim_bytes:1.18513664e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04836864e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:17:56.27105+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:57.47997+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.920202682, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:57.49471+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.4135552430000002, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:56.49576+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:57.71962+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:17:57.71956+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:57.71963+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:57.75102+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:17:57.86507+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:17:57.8676+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=9.943434271, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T17:17:57.86786+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:17:57.87135+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T17:17:57.8722+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.784914482, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:57.95461+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:17:57.88721+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:17:57.87683+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.946688397, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:57.87481+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:57.96597+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:58.23393+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:17:58.23787+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.764101315, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:57.59303+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:41.82672+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.38098853, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:41.82618+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.009109943, err="couldn't get SNTP reply: read udp 127.0.0.1:6899->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:58.50806+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.996219004, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:17:58.56972+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:45.8277+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:17:45.7786+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:45.79176+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:41.83822+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:41.90809+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:41.91531+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:41.83946+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:41.84939+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:41.87714+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=0, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=74536.07, old_value=74536.12 2023-07-21T17:17:41.9372+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.01529301, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:17:41.93574+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:41.89622+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001710757, err="couldn't get SNTP reply: read udp 127.0.0.1:35299->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:17:41.83594+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:17:41.87475+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T17:17:58.83162+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:17:41.93562+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:17:41.87942+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:17:41.92997+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:58.8697+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:17:58.83186+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:58.9331+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:17:58.93291+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:17:59.03872+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:17:58.87034+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:17:59.07348+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T17:17:59.20352+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:59.08756+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:17:59.33644+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T17:17:45.81976+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:59.46447+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:59.41544+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:17:59.10223+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:59.46451+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:59.57558+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:59.70623+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:41.92174+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1121608704e+10 Active_bytes:3.2459337728e+10 Active_file_bytes:1.337729024e+09 AnonHugePages_bytes:2.9597106176e+10 AnonPages_bytes:3.1120605184e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839480832e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6670775296e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:593920 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03369728e+08 Inactive_file_bytes:4.86068224e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26808064e+08 MemAvailable_bytes:1.3466738688e+10 MemFree_bytes:1.5834624e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4887168e+07 SReclaimable_bytes:8.6298624e+07 SUnreclaim_bytes:1.17940224e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04238848e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:00.00148+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:00.00241+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:59.36652+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:00.16085+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:59.82702+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:00.43645+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:00.58585+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:00.56294+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:45.79142+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000966703, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:00.27147+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:45.83932+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.027392817, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:00.44431+08:00 WARN [26106,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T17:18:00.62145+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:00.39902+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.99 2023-07-21T17:18:00.58668+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:59.09078+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:18:00.68394+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:00.68591+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:00.83678+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:00.83883+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:00.89697+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:00.56148+08:00 WARN [26106,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T17:18:00.73292+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:00.89116+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:05.24255+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:05.17653+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:04.62252+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.046911785, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:05.27091+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:00.93067+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:00.89728+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:03.21262+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:00.90007+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=19.226543062, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:05.42855+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:00.93289+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:00.92484+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:00.9087+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:00.93076+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:00.94861+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:18:01.04824+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:00.93397+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:00.93224+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=29.088146641, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:01.24681+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:00.94727+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1172816896e+10 Active_bytes:3.2510603264e+10 Active_file_bytes:1.337786368e+09 AnonHugePages_bytes:2.9620174848e+10 AnonPages_bytes:3.1172902912e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839529984e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6702396416e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:643072 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03365632e+08 Inactive_file_bytes:4.86064128e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26857216e+08 MemAvailable_bytes:1.3414883328e+10 MemFree_bytes:1.5782744064e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5825152e+07 SReclaimable_bytes:8.630272e+07 SUnreclaim_bytes:1.17997568e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04300288e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:01.19342+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:01.26389+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:01.04838+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:01.24048+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:01.26395+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:18:01.08473+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.99 2023-07-21T17:18:01.31373+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:01.31594+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:01.49781+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:01.24742+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=16.722609962, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:00.93418+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:01.31359+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:01.49979+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000859566, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:01.7157+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:01.50039+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:01.23367+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000946876, err="couldn't get SNTP reply: read udp 127.0.0.1:6926->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:00.95852+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:01.23947+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:01.97589+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:02.11113+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.013555415, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:02.11149+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:02.11042+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:02.12509+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=8.121758853, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:02.16818+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:02.40178+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.21 2023-07-21T17:18:02.41082+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:02.42344+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:02.43741+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:02.43274+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:02.95118+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:02.97279+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:02.97632+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.6663850340000002, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:02.98243+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:02.97555+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:02.94803+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:02.99791+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:03.00022+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=15.96090063, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:02.94896+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1193399296e+10 Active_bytes:3.253121024e+10 Active_file_bytes:1.337810944e+09 AnonHugePages_bytes:2.9609689088e+10 AnonPages_bytes:3.1193542656e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839558656e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.670921216e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:671744 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03369728e+08 Inactive_file_bytes:4.86068224e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.26865408e+08 MemAvailable_bytes:1.3393027072e+10 MemFree_bytes:1.5760871424e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.6722176e+07 SReclaimable_bytes:8.630272e+07 SUnreclaim_bytes:1.18022144e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04324864e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:02.4262+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.258777827, err="couldn't get SNTP reply: read udp 127.0.0.1:17316->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:02.99637+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:03.16473+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:03.09863+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.21 2023-07-21T17:18:03.11046+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:03.10701+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.160659601, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:03.16775+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.166679542, err="couldn't get SNTP reply: read udp 127.0.0.1:36329->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:03.1683+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:03.18323+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:03.18342+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:03.20066+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.152935208, err="couldn't get SNTP reply: read udp 127.0.0.1:63574->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:03.17227+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=17.367493646, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:03.20458+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:03.20448+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:00.92699+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:05.44877+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:04.6274+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:18:05.54408+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:07.7868+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:18:07.78955+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:03.2189+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.726132307, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:03.22514+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:17:45.8272+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.03 2023-07-21T17:18:03.24473+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.042488712, err="couldn't get SNTP reply: read udp 127.0.0.1:5680->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:03.37981+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:03.43077+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.21 2023-07-21T17:18:03.43145+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:03.42978+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.146780672e+10 Active_bytes:3.2805924864e+10 Active_file_bytes:1.338118144e+09 AnonHugePages_bytes:2.9636952064e+10 AnonPages_bytes:3.1468785664e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.83988224e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6829618176e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:311296 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03386112e+08 Inactive_file_bytes:4.86084608e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.27254528e+08 MemAvailable_bytes:1.3111963648e+10 MemFree_bytes:1.5479635968e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9695872e+07 SReclaimable_bytes:8.6327296e+07 SUnreclaim_bytes:1.18530048e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04857344e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:03.4535+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1460712448e+10 Active_bytes:3.2798830592e+10 Active_file_bytes:1.338118144e+09 AnonHugePages_bytes:2.9636952064e+10 AnonPages_bytes:3.1460429824e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.83988224e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.682578432e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:311296 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03386112e+08 Inactive_file_bytes:4.86084608e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.27254528e+08 MemAvailable_bytes:1.3119275008e+10 MemFree_bytes:1.5486947328e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9695872e+07 SReclaimable_bytes:8.6327296e+07 SUnreclaim_bytes:1.18530048e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04857344e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:03.44962+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:03.45775+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:03.45778+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.025031323, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:03.5043+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:03.58775+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.641502797, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:03.6492+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:03.45851+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:03.5145+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:03.50165+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:03.68245+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:03.68259+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:03.6839+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.21 2023-07-21T17:18:03.69385+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.243407368, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:03.69668+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.21 2023-07-21T17:18:03.6963+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:03.83053+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:03.84361+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.412824912, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:03.6919+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.491107471, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:03.93253+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.225510756, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:03.93103+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:03.94198+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:03.94279+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.113382747, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:04.01668+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:04.09645+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:04.0961+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:18:04.09604+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=18.585912263, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:04.09332+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:04.62233+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:18:04.33235+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.21 2023-07-21T17:18:04.62485+08:00 ERROR [26106,] caller=engine/route_manager.go:173:pull: failed to write http response from buffer fields: error="write tcp 172.118.81.152:8088->172.118.81.153:44234: write: broken pipe" 2023-07-21T17:18:05.54458+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:18:07.78799+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:18:04.56951+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=0, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=5708.14, old_value=5708.17 2023-07-21T17:18:04.62937+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:04.46851+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.969552253, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:05.07217+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.266062936, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:05.08503+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:05.08308+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:18:05.12325+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:05.13387+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:05.07269+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1511830528e+10 Active_bytes:3.2849997824e+10 Active_file_bytes:1.338167296e+09 AnonHugePages_bytes:2.965372928e+10 AnonPages_bytes:3.151183872e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839931392e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6857556992e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:364544 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03386112e+08 Inactive_file_bytes:4.86084608e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.2726272e+08 MemAvailable_bytes:1.3067812864e+10 MemFree_bytes:1.5435460608e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0228352e+07 SReclaimable_bytes:8.6327296e+07 SUnreclaim_bytes:1.18530048e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04857344e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:05.16303+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:05.16342+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.99 2023-07-21T17:18:05.16358+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:05.17132+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:05.17161+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=29.031725153, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:18:05.284+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:05.45031+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:05.45078+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:05.45062+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:05.45084+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:05.44975+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:07.7912+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:05.59204+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:18:05.66561+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:05.6929+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:18:05.69419+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:05.68118+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:05.7043+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.016288575, err="couldn't get SNTP reply: read udp 127.0.0.1:9414->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:05.6932+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.99 2023-07-21T17:18:05.67997+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000610296, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:05.7109+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:05.71457+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:05.71176+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:05.71271+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.350385497, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:05.9427+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:05.80447+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.21 2023-07-21T17:18:05.80434+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:18:05.94475+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:05.94324+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.049513846, err="couldn't get SNTP reply: read udp 127.0.0.1:25782->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:05.95613+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=29.845498539, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:06.03741+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:06.07857+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.273842217, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:05.75987+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1547998208e+10 Active_bytes:3.2886185984e+10 Active_file_bytes:1.338187776e+09 AnonHugePages_bytes:2.9666312192e+10 AnonPages_bytes:3.1548260352e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839960064e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.687921664e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:393216 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03390208e+08 Inactive_file_bytes:4.86088704e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.27266816e+08 MemAvailable_bytes:1.3031399424e+10 MemFree_bytes:1.539903488e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0560128e+07 SReclaimable_bytes:8.6327296e+07 SUnreclaim_bytes:1.18534144e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.0486144e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:05.71307+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=20.170539751, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:06.14795+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:06.14822+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:06.15239+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.21 2023-07-21T17:18:06.09051+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:06.66975+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:07.67559+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:07.21639+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:07.69238+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:06.31355+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:07.69131+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001900079, err="couldn't get SNTP reply: read udp 127.0.0.1:26258->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:06.37585+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=20.564383029, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:06.12657+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.056762346, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:06.15284+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.116131614, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:06.1346+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.445562922, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:07.70406+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:07.70465+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:07.70817+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.005530375, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:08.61286+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=13.503617766, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:18:07.69621+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.9498932519999999, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:08.7233+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.019805449, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:08.71614+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:08.41629+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:07.70719+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:08.4165+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:18:08.72575+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:07.70546+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1572041728e+10 Active_bytes:3.2910258176e+10 Active_file_bytes:1.338216448e+09 AnonHugePages_bytes:2.9651632128e+10 AnonPages_bytes:3.1571648512e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839992832e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6881313792e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:303104 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03390208e+08 Inactive_file_bytes:4.86088704e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.27266816e+08 MemAvailable_bytes:1.3005807616e+10 MemFree_bytes:1.5373426688e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0769024e+07 SReclaimable_bytes:8.6327296e+07 SUnreclaim_bytes:1.18370304e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.046976e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:05.58317+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:18:07.8579+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:07.86187+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:07.84095+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:07.85671+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:07.86708+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:07.71745+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=22.207314694, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:07.86941+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.59 2023-07-21T17:18:07.86982+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:07.88629+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:07.89493+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=22.383955901, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:18:07.87446+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:07.89619+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:07.91505+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=26.44 2023-07-21T17:18:07.90148+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:07.93539+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:07.93493+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.012817079, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:07.94555+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.271950045, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:07.96132+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:07.93482+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:07.96528+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:08.2715+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:08.41128+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:08.07894+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.749163833, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:08.27017+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.310778669, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:08.41128+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:08.7507+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:08.41681+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=26.44 2023-07-21T17:18:08.44508+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:18:08.44691+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000613102, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:08.44643+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:08.4466+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:18:08.44654+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=1, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=75247.04, old_value=75247.14 2023-07-21T17:17:45.79161+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:08.58915+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T17:18:08.57044+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:08.71508+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:08.6172+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:08.618+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:08.61766+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:08.66264+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:08.66747+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:08.66752+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:08.67267+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:18:08.68174+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:08.66964+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=26.44 2023-07-21T17:18:08.68632+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000758532, err="couldn't get SNTP reply: read udp 127.0.0.1:23336->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:08.68727+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.59 2023-07-21T17:18:08.66229+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:18:08.66959+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=13.975297186, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:18:08.63199+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:18:08.68491+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.015578511, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:08.68756+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:08.69062+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:08.69586+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:08.69793+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.024572294, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:08.70304+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:08.61572+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.980504398, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:08.69774+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=26.44 2023-07-21T17:18:08.70197+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:08.70371+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:08.78839+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.1146868699999999, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:08.71486+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1612264448e+10 Active_bytes:3.2950505472e+10 Active_file_bytes:1.338241024e+09 AnonHugePages_bytes:2.9655826432e+10 AnonPages_bytes:3.1608766464e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840013312e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6901924864e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:323584 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03390208e+08 Inactive_file_bytes:4.86088704e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.27270912e+08 MemAvailable_bytes:1.296685056e+10 MemFree_bytes:1.5334457344e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.1219584e+07 SReclaimable_bytes:8.6327296e+07 SUnreclaim_bytes:1.18370304e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.046976e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:08.78643+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:18:08.78651+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:18:08.78858+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:18:08.97264+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=26.3 2023-07-21T17:18:08.97476+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:08.97709+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:09.06097+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:09.06101+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.183736027, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:09.15906+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:09.1593+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:09.12324+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:09.387+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:09.23255+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:09.34747+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:09.38223+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000709456, err="couldn't get SNTP reply: read udp 127.0.0.1:39343->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:09.26954+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=23.662145815, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:09.24339+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:09.37506+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:09.57652+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:09.59152+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:18:09.3947+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:09.57606+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.533377789, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:09.57198+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1659839488e+10 Active_bytes:3.299811328e+10 Active_file_bytes:1.338273792e+09 AnonHugePages_bytes:2.966421504e+10 AnonPages_bytes:3.1658483712e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840041984e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6924174336e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:352256 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03390208e+08 Inactive_file_bytes:4.86088704e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.27270912e+08 MemAvailable_bytes:1.2919185408e+10 MemFree_bytes:1.5286775808e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.16128e+07 SReclaimable_bytes:8.6327296e+07 SUnreclaim_bytes:1.183744e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04701696e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:09.40619+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.01096758, err="couldn't get SNTP reply: read udp 127.0.0.1:17524->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:09.38164+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:09.39621+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1647432704e+10 Active_bytes:3.29857024e+10 Active_file_bytes:1.338269696e+09 AnonHugePages_bytes:2.9662117888e+10 AnonPages_bytes:3.1645749248e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840037888e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.691788288e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:348160 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03390208e+08 Inactive_file_bytes:4.86088704e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.27270912e+08 MemAvailable_bytes:1.2932345856e+10 MemFree_bytes:1.5299940352e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.1420288e+07 SReclaimable_bytes:8.6327296e+07 SUnreclaim_bytes:1.183744e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04701696e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:09.39206+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:09.48363+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:09.37589+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:09.57333+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:09.37608+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:09.38636+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.029220401, err="couldn't get SNTP reply: read udp 127.0.0.1:7022->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:09.5762+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.059201263, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:09.5912+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000828986, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:09.08279+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.08 2023-07-21T17:18:09.48446+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1654121472e+10 Active_bytes:3.2992395264e+10 Active_file_bytes:1.338273792e+09 AnonHugePages_bytes:2.966421504e+10 AnonPages_bytes:3.165458432e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840041984e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6924174336e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:352256 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03390208e+08 Inactive_file_bytes:4.86088704e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.27270912e+08 MemAvailable_bytes:1.2924837888e+10 MemFree_bytes:1.5292428288e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.16128e+07 SReclaimable_bytes:8.6327296e+07 SUnreclaim_bytes:1.183744e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04701696e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:09.75672+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:09.75597+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:18:09.75593+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:09.7572+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.08 2023-07-21T17:18:09.78748+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:18:09.79975+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=1, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=5596.81, old_value=5596.83 2023-07-21T17:18:09.80341+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:09.80308+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:09.80318+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:18:09.80556+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T17:18:09.86294+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:09.99161+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:09.89705+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.027457717, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:10.02491+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:10.02615+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:09.99092+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:09.99265+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.02649+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.06627+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:18:10.04228+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:18:10.06569+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=26.3 2023-07-21T17:18:09.99983+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:09.99289+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.02994+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.59 2023-07-21T17:18:10.02737+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.02649+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.03035+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.08 2023-07-21T17:18:10.09939+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:18:10.10019+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:10.10251+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.32866+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:18:10.32248+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:10.37343+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:18:10.32692+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.177343108, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:10.25997+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:09.94574+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:10.37728+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.08 2023-07-21T17:18:10.89193+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:10.38829+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:18:10.89132+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:10.38937+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.38237+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:10.39005+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:18:10.41048+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.39824+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.01 2023-07-21T17:18:10.39076+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:18:10.42921+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.42719+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.70327+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.83489+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.86272+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.89127+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=7.668264297, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:18:11.23578+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.0741+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.6280531400000005, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:18:11.23587+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=1, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=2333.82, old_value=2333.83 2023-07-21T17:18:11.23552+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:18:11.00107+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:18:11.28159+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.29561+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T17:18:10.91419+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:11.63087+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.63333+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:18:11.63373+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.01 2023-07-21T17:18:16.66652+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:16.66874+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.694624665, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:16.67005+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=7.983805699, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:18:16.67227+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=25.20076391, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:16.68037+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.288026207, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:11.87418+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:16.68333+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:16.6939+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:11.30502+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:18:16.71648+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:18:16.71795+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:18:16.71895+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:18:16.72458+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:18:16.72549+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:18:16.7205+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1769268224e+10 Active_bytes:3.3107668992e+10 Active_file_bytes:1.338400768e+09 AnonHugePages_bytes:2.9689380864e+10 AnonPages_bytes:3.1774621696e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840164864e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6976635904e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:454656 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.03390208e+08 Inactive_file_bytes:4.86084608e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.2730368e+08 MemAvailable_bytes:1.2808409088e+10 MemFree_bytes:1.5175933952e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2608128e+07 SReclaimable_bytes:8.6331392e+07 SUnreclaim_bytes:1.18398976e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04730368e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:16.73068+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:18:16.73167+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:18:16.73266+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:18:11.88189+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00154417, err="couldn't get SNTP reply: read udp 127.0.0.1:19996->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:16.74346+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T17:18:11.63306+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:18:11.63857+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.62457+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:18:11.63888+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=17.989482607, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:51.10659+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:11.64192+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.64209+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:17:51.47101+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:50.39787+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.125962752e+10 Active_bytes:3.2597516288e+10 Active_file_bytes:1.337888768e+09 AnonHugePages_bytes:2.9609689088e+10 AnonPages_bytes:3.1262052352e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839693824e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6738936832e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:757760 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7313792e+07 Inactive_bytes:5.03382016e+08 Inactive_file_bytes:4.86068224e+08 KernelStack_bytes:2.3887872e+07 Mapped_bytes:1.27516672e+08 MemAvailable_bytes:1.3318217728e+10 MemFree_bytes:1.568602112e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9376384e+07 SReclaimable_bytes:8.6306816e+07 SUnreclaim_bytes:1.18525952e+08 Shmem_bytes:1.7870848e+07 Slab_bytes:2.04832768e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:11.65054+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.64462+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:18:11.87477+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001345087, err="couldn't get SNTP reply: read udp 127.0.0.1:46475->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:11.78946+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.921951104, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:18:16.7796+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:11.79023+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:18:11.78994+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:18:11.78927+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.637645979, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:18:11.69089+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:18:11.64188+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.8376038999999995, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:18:11.78935+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.82616+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.929778437, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:16.74306+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=25.249842373, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:11.82617+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=19.325069967, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:17:51.47134+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.007076306, err="couldn't get SNTP reply: read udp 127.0.0.1:6636->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:11.82659+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:18:11.82662+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.82618+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.86523+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.82671+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.88241+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:11.88247+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=2, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=75395.28, old_value=75395.34 2023-07-21T17:18:11.8821+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:11.89139+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=26.44 2023-07-21T17:18:11.89163+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.286149472, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:11.89242+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.95234+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.5472038660000003, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:11.99046+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=22.31263133, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:11.98447+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:11.89342+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.021196529, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:11.8966+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.124273152e+10 Active_bytes:3.2580583424e+10 Active_file_bytes:1.337851904e+09 AnonHugePages_bytes:2.9609689088e+10 AnonPages_bytes:3.1242952704e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.83965696e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6731949056e+10 DirectMap2M_bytes:5.0407145472e+10 DirectMap4k_bytes:1.132331008e+09 Dirty_bytes:720896 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7313792e+07 Inactive_bytes:5.03382016e+08 Inactive_file_bytes:4.86068224e+08 KernelStack_bytes:2.3822336e+07 Mapped_bytes:1.28438272e+08 MemAvailable_bytes:1.3340438528e+10 MemFree_bytes:1.5708258304e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.8639104e+07 SReclaimable_bytes:8.6306816e+07 SUnreclaim_bytes:1.18349824e+08 Shmem_bytes:1.7870848e+07 Slab_bytes:2.0465664e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:11.98395+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:12.07693+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:12.04306+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:12.05971+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1747387392e+10 Active_bytes:3.3085698048e+10 Active_file_bytes:1.338310656e+09 AnonHugePages_bytes:2.9676797952e+10 AnonPages_bytes:3.1745908736e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840078848e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.696392192e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:368640 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03386112e+08 Inactive_file_bytes:4.86084608e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.27291392e+08 MemAvailable_bytes:1.2831858688e+10 MemFree_bytes:1.5199428608e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2223104e+07 SReclaimable_bytes:8.6331392e+07 SUnreclaim_bytes:1.18386688e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.0471808e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:13.88497+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T17:18:14.86874+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:14.65527+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:18:14.66552+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:15.42718+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:15.43753+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:15.43203+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:15.50803+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:15.5088+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:15.50926+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:16.43306+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:16.43493+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:16.43349+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:16.46202+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:16.56506+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:15.75685+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.641437798, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:16.60919+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=29.579534271, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:16.60972+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:16.60941+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:16.60967+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:11.87459+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.88194+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=25.66 2023-07-21T17:18:16.56521+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T17:18:16.84654+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=7.47859987, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:16.8441+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:16.84431+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:17.08129+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Mount point timed out, it is being labeled as stuck and will not be monitored", mountpoint=/ 2023-07-21T17:18:17.07084+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=38.338456627, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:17.34342+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:18:16.84856+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:18:16.85313+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1281152e+10 Active_bytes:3.261906944e+10 Active_file_bytes:1.33791744e+09 AnonHugePages_bytes:2.961178624e+10 AnonPages_bytes:3.127883776e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839665152e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.675168768e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:446464 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03365632e+08 Inactive_file_bytes:4.86064128e+08 KernelStack_bytes:2.37568e+07 Mapped_bytes:1.26947328e+08 MemAvailable_bytes:1.3301559296e+10 MemFree_bytes:1.56693504e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.8204928e+07 SReclaimable_bytes:8.6306816e+07 SUnreclaim_bytes:1.185792e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04886016e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:17.45206+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.17845504e+10 Active_bytes:3.3122951168e+10 Active_file_bytes:1.338400768e+09 AnonHugePages_bytes:2.9689380864e+10 AnonPages_bytes:3.1790219264e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840164864e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.697768448e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:454656 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.03390208e+08 Inactive_file_bytes:4.86084608e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.2730368e+08 MemAvailable_bytes:1.2793442304e+10 MemFree_bytes:1.5160967168e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2608128e+07 SReclaimable_bytes:8.6331392e+07 SUnreclaim_bytes:1.18398976e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04730368e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:17.49237+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.697746096, err="couldn't get SNTP reply: read udp 127.0.0.1:47453->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:17.80878+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:17.81927+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.187961852, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:17.81978+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:17.99969+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:18:18.00049+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:17:41.82507+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:41.82545+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:18.05802+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:18.08317+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:18.07506+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:18:18.04804+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:18.08369+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:18.04816+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:18.0891+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:18.08336+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.121552934, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:18.09514+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:18.09107+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:18.08533+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:18.08293+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:17:41.80001+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:18.11789+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:18.18839+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:17:41.78519+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:18:18.19785+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=25.328052633, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:18:18.20078+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:18.23604+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:18.19792+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:18.24217+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:18.42133+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:18.32121+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=42.14 2023-07-21T17:18:18.41591+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:18.31761+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:18.46449+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.114412475, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:18.84827+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:18.58579+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:18.72869+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.945752363, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:19.76802+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:19.97023+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=42.14 2023-07-21T17:18:20.62+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T17:18:00.2887+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:00.27787+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:45.82513+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:00.288+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:17:45.78376+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00518713, err="couldn't get SNTP reply: read udp 127.0.0.1:54728->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:20.62461+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:20.63402+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:20.76701+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=42.14 2023-07-21T17:18:20.79174+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:20.79726+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=26.130043043, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T17:18:20.79647+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T17:18:20.97763+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.146974539, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:22.10251+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:22.88336+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.28324766, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:22.93721+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:23.16103+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:18:23.16281+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=43.01 2023-07-21T17:18:23.16504+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.023934903, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:22.9437+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.190482944e+10 Active_bytes:3.3243295744e+10 Active_file_bytes:1.338466304e+09 AnonHugePages_bytes:2.969567232e+10 AnonPages_bytes:3.1904710656e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840242688e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7036732416e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:368640 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03390208e+08 Inactive_file_bytes:4.86088704e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.27320064e+08 MemAvailable_bytes:1.2672585728e+10 MemFree_bytes:1.5040077824e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.4127744e+07 SReclaimable_bytes:8.6331392e+07 SUnreclaim_bytes:1.18448128e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.0477952e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:02.41206+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.246583033, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:23.16508+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.024142388, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:23.17893+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:18:23.17942+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:23.28815+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:23.28883+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:23.30346+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.986249332, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:23.16234+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.02107395, err="couldn't get SNTP reply: read udp 127.0.0.1:12771->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:02.41082+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:02.44233+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.007745807, err="couldn't get SNTP reply: read udp 127.0.0.1:40384->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:23.38239+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:23.38254+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=43.01 2023-07-21T17:18:02.43056+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:02.4466+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:23.38272+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:23.36198+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:02.41449+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1431090176e+10 Active_bytes:3.2769191936e+10 Active_file_bytes:1.33810176e+09 AnonHugePages_bytes:2.9634854912e+10 AnonPages_bytes:3.143100416e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839865856e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6814102528e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:290816 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03386112e+08 Inactive_file_bytes:4.86084608e+08 KernelStack_bytes:2.3691264e+07 Mapped_bytes:1.26976e+08 MemAvailable_bytes:1.3150302208e+10 MemFree_bytes:1.551798272e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9286272e+07 SReclaimable_bytes:8.6327296e+07 SUnreclaim_bytes:1.18521856e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04849152e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:23.48807+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T17:18:02.58948+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:23.5152+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.643962146, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:23.53438+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T17:18:02.59942+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:23.55733+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:23.55739+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:23.57964+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:23.58824+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=31.788742159999998, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:02.44968+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=16.633124373, err="couldn't get SNTP reply: read udp 127.0.0.1:10281->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:23.56518+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.683686783, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:23.97024+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:18:24.05684+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:18:23.97025+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:18:23.64502+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=43.01 2023-07-21T17:18:24.19492+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:24.28849+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T17:18:24.34696+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:18:24.36385+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:18:24.24493+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:18:24.40528+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:24.40592+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:24.48339+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:24.48587+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:02.60229+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.14545152e+10 Active_bytes:3.2792633344e+10 Active_file_bytes:1.338118144e+09 AnonHugePages_bytes:2.9636952064e+10 AnonPages_bytes:3.145517056e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.83988224e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.682316288e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:311296 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03386112e+08 Inactive_file_bytes:4.86084608e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.27254528e+08 MemAvailable_bytes:1.31258368e+10 MemFree_bytes:1.549350912e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9695872e+07 SReclaimable_bytes:8.6327296e+07 SUnreclaim_bytes:1.18530048e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04857344e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:24.48821+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1915364352e+10 Active_bytes:3.3253838848e+10 Active_file_bytes:1.338474496e+09 AnonHugePages_bytes:2.969567232e+10 AnonPages_bytes:3.191570432e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.84025088e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7044072448e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:376832 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03390208e+08 Inactive_file_bytes:4.86088704e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.27320064e+08 MemAvailable_bytes:1.2659765248e+10 MemFree_bytes:1.5027253248e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.4340736e+07 SReclaimable_bytes:8.6331392e+07 SUnreclaim_bytes:1.18464512e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04795904e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:24.58289+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:24.58293+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:24.58807+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:24.40282+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:24.58838+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000632587, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:24.58837+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:05.14345+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:05.14384+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:05.13026+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:18:05.14662+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:24.59656+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:24.5972+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:24.59265+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:24.76137+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:24.85901+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:24.86568+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T17:18:25.27013+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:25.13743+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T17:18:25.39089+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002352019, err="couldn't get SNTP reply: read udp 127.0.0.1:57200->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:25.52577+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=43.01 2023-07-21T17:18:25.808+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:25.63649+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:18:28.64182+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=30.91 2023-07-21T17:18:05.15471+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:04.63016+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000715879, err="couldn't get SNTP reply: read udp 127.0.0.1:13790->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:05.15583+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:05.15313+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:17:45.82804+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.6551487160000002, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T17:18:10.38999+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:10.39103+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:10.40292+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.59 2023-07-21T17:18:30.06019+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:30.06948+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=30.732641117, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:30.14609+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:10.42917+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:10.41407+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.030919382, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:10.70473+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.357720195, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:10.40792+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.705772619, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:30.22125+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:18:30.14584+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:10.70567+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:18:10.74588+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:10.7458+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:10.83952+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:10.73549+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.035400527, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:10.73547+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:10.86442+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.520859776, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:43.94403+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:43.94451+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:10.89042+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:52.39814+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:52.40005+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:52.22185+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=37.13 2023-07-21T17:18:52.53066+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.22 2023-07-21T17:18:52.53231+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=31.46 2023-07-21T17:18:52.65597+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=32.314626008, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:18:52.72561+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:52.72732+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:52.72839+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=32.461038922, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:52.72806+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:52.73205+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:52.73224+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=35.837811863, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:52.73175+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.185543168e+10 Active_bytes:3.3193873408e+10 Active_file_bytes:1.338441728e+09 AnonHugePages_bytes:2.9689380864e+10 AnonPages_bytes:3.1855149056e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840205824e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.700144128e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:512000 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03386112e+08 Inactive_file_bytes:4.86084608e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.27315968e+08 MemAvailable_bytes:1.2721987584e+10 MemFree_bytes:1.5089491968e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.33536e+07 SReclaimable_bytes:8.6331392e+07 SUnreclaim_bytes:1.18423552e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04754944e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:52.74625+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00751027, err="couldn't get SNTP reply: read udp 127.0.0.1:54243->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:52.75304+08:00 ERROR [26106,] caller=engine/route_manager.go:173:pull: failed to write http response from buffer fields: error="write tcp 172.118.81.152:8088->172.118.81.151:31950: write: broken pipe" 2023-07-21T17:18:52.75893+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:52.76753+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.009333609, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:52.7585+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.22735104e+10 Active_bytes:3.3612259328e+10 Active_file_bytes:1.338748928e+09 AnonHugePages_bytes:2.9691478016e+10 AnonPages_bytes:3.2274087936e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840533504e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7330857984e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:200704 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03406592e+08 Inactive_file_bytes:4.86105088e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.27373312e+08 MemAvailable_bytes:1.2287541248e+10 MemFree_bytes:1.4654877696e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:9.0923008e+07 SReclaimable_bytes:8.6339584e+07 SUnreclaim_bytes:1.19390208e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.05729792e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:52.77472+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=33.485195726, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:52.78751+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:52.80202+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:10.86625+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:30.31049+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.11593589, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:30.29617+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:44.06251+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.2159035392e+10 Active_bytes:3.3497698304e+10 Active_file_bytes:1.338662912e+09 AnonHugePages_bytes:2.9691478016e+10 AnonPages_bytes:3.2159096832e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840447488e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7230227456e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:135168 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03402496e+08 Inactive_file_bytes:4.86100992e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.2736512e+08 MemAvailable_bytes:1.2408098816e+10 MemFree_bytes:1.4775484416e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.8920064e+07 SReclaimable_bytes:8.6335488e+07 SUnreclaim_bytes:1.1900928e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.05344768e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:10.97334+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:30.51835+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:30.69404+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=26.850179798, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:06.31407+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:18:31.55493+08:00 INFO [26106,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T17:18:31.38841+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:31.38839+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:31.08507+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:30.68794+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T17:18:06.37933+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:31.08452+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1474143232e+10 Active_bytes:3.2812265472e+10 Active_file_bytes:1.33812224e+09 AnonHugePages_bytes:2.9636952064e+10 AnonPages_bytes:3.1476002816e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.839890432e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6837482496e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:319488 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03386112e+08 Inactive_file_bytes:4.86084608e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.27258624e+08 MemAvailable_bytes:1.3102170112e+10 MemFree_bytes:1.5469838336e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.99744e+07 SReclaimable_bytes:8.6327296e+07 SUnreclaim_bytes:1.18530048e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04857344e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:31.50398+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:31.70287+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:11.00052+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.657563337, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:31.7302+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=38.468509373, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:31.73078+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:31.7319+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:31.73082+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:31.65638+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.69527986, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:31.80775+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=47.275987132, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:07.66461+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:36.87744+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.003207606, err="couldn't get SNTP reply: read udp 127.0.0.1:29236->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:36.87908+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002260375, err="couldn't get SNTP reply: read udp 127.0.0.1:65138->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:36.88103+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.2049864704e+10 Active_bytes:3.33884416e+10 Active_file_bytes:1.338576896e+09 AnonHugePages_bytes:2.9691478016e+10 AnonPages_bytes:3.2050294784e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840357376e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7139361792e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:180224 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03394304e+08 Inactive_file_bytes:4.860928e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.2736512e+08 MemAvailable_bytes:1.2520329216e+10 MemFree_bytes:1.4887763968e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.6392832e+07 SReclaimable_bytes:8.6331392e+07 SUnreclaim_bytes:1.1866112e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04992512e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:11.27897+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:11.27703+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:11.23824+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:36.89338+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.2053116928e+10 Active_bytes:3.339169792e+10 Active_file_bytes:1.338580992e+09 AnonHugePages_bytes:2.9691478016e+10 AnonPages_bytes:3.2052793344e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840369664e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7141983232e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:192512 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.033984e+08 Inactive_file_bytes:4.86096896e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.2736512e+08 MemAvailable_bytes:1.25161472e+10 MemFree_bytes:1.4883577856e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.6913024e+07 SReclaimable_bytes:8.6335488e+07 SUnreclaim_bytes:1.18714368e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.05049856e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:36.9157+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.097886609, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:36.90884+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000854281, err="couldn't get SNTP reply: read udp 127.0.0.1:16556->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:36.90887+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.205892096e+10 Active_bytes:3.3397501952e+10 Active_file_bytes:1.338580992e+09 AnonHugePages_bytes:2.9691478016e+10 AnonPages_bytes:3.2059527168e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840369664e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7151420416e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:192512 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.033984e+08 Inactive_file_bytes:4.86096896e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.2736512e+08 MemAvailable_bytes:1.2509446144e+10 MemFree_bytes:1.48768768e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.6913024e+07 SReclaimable_bytes:8.6335488e+07 SUnreclaim_bytes:1.18714368e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.05049856e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:52.19655+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:11.31756+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:11.33525+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:36.9357+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.005687866, err="couldn't get SNTP reply: read udp 127.0.0.1:25759->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:11.41023+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:11.34349+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:36.93689+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.426112198, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:36.93583+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.003883417, err="couldn't get SNTP reply: read udp 127.0.0.1:28002->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:37.01804+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:37.0186+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:11.41967+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:11.42018+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:37.0352+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.100627142, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:37.04383+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.008970125, err="couldn't get SNTP reply: read udp 127.0.0.1:46717->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:11.40953+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:37.14548+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:37.14445+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=32.444615205, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:37.1594+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.73 2023-07-21T17:18:37.19736+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.211986861, err="couldn't get SNTP reply: read udp 127.0.0.1:56821->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:37.25386+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:37.25575+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:37.25549+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:37.2623+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.2073535488e+10 Active_bytes:3.341211648e+10 Active_file_bytes:1.338580992e+09 AnonHugePages_bytes:2.9691478016e+10 AnonPages_bytes:3.2073453568e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840369664e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7159284736e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:192512 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.033984e+08 Inactive_file_bytes:4.86096896e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.2736512e+08 MemAvailable_bytes:1.2496142336e+10 MemFree_bytes:1.4863572992e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.6913024e+07 SReclaimable_bytes:8.6335488e+07 SUnreclaim_bytes:1.18714368e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.05049856e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:37.39031+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:37.37547+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:37.26175+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:11.47383+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:11.52008+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001049071, err="couldn't get SNTP reply: read udp 127.0.0.1:17205->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:11.56914+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.59 2023-07-21T17:18:11.57547+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.044322873, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:11.57558+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:11.47237+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:11.57572+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:11.57579+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.59 2023-07-21T17:18:11.6088+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:18:11.62022+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:11.57574+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:11.61125+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:37.4051+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:18.85239+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:18.84756+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.218702953, err="couldn't get SNTP reply: read udp 127.0.0.1:25045->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:37.44086+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:18.8996+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.697503165, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:37.44442+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:37.44471+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:11.49368+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:37.45303+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:37.45632+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=34.555438707, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:37.45966+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.2073740288e+10 Active_bytes:3.3412325376e+10 Active_file_bytes:1.338585088e+09 AnonHugePages_bytes:2.9693575168e+10 AnonPages_bytes:3.2075927552e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840377856e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7161381888e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:188416 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03406592e+08 Inactive_file_bytes:4.86105088e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.2736512e+08 MemAvailable_bytes:1.2495200256e+10 MemFree_bytes:1.486262272e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.72448e+07 SReclaimable_bytes:8.6335488e+07 SUnreclaim_bytes:1.18759424e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.05094912e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:37.52053+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:37.8107+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.2076582912e+10 Active_bytes:3.3415172096e+10 Active_file_bytes:1.338589184e+09 AnonHugePages_bytes:2.9691478016e+10 AnonPages_bytes:3.2076644352e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840381952e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7161906176e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:192512 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03414784e+08 Inactive_file_bytes:4.8611328e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.2736512e+08 MemAvailable_bytes:1.2493295616e+10 MemFree_bytes:1.4860713984e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.747008e+07 SReclaimable_bytes:8.6335488e+07 SUnreclaim_bytes:1.18796288e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.05131776e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:37.6879+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T17:18:37.54602+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=40.31 2023-07-21T17:18:37.81679+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:37.81549+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:19.80447+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:19.74003+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:19.80702+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.37891316, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:38.23748+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.200407509, err="couldn't get SNTP reply: read udp 127.0.0.1:24235->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:38.1871+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002805039, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:38.29046+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.615348989, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:38.18694+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:37.73077+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:38.18747+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:38.84978+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:38.85118+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=30.795066559, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:42.73171+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T17:18:40.94327+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=40.31 2023-07-21T17:18:42.7961+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=55.741962422, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:42.81772+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:42.77437+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T17:18:42.77896+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:42.81882+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.214655488e+10 Active_bytes:3.3485193216e+10 Active_file_bytes:1.338638336e+09 AnonHugePages_bytes:2.9691478016e+10 AnonPages_bytes:3.2146567168e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840431104e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7220790272e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:118784 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03406592e+08 Inactive_file_bytes:4.86105088e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.2736512e+08 MemAvailable_bytes:1.2419760128e+10 MemFree_bytes:1.4787158016e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.8633344e+07 SReclaimable_bytes:8.6335488e+07 SUnreclaim_bytes:1.18951936e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.05287424e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:42.91574+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:42.91258+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=56.376726739, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:42.95821+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:44.7252+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.24 2023-07-21T17:18:44.18784+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:18:44.8482+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.117026026, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:44.74628+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:44.84908+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.13652075, err="couldn't get SNTP reply: read udp 127.0.0.1:60211->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:20.01671+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.675426451, err="couldn't get SNTP reply: read udp 127.0.0.1:34205->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:20.08887+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.643155621, err="couldn't get SNTP reply: read udp 127.0.0.1:11800->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:19.97151+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:20.12503+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:20.08907+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:20.242+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:44.82556+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:20.2646+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:20.2632+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1849037824e+10 Active_bytes:3.3187467264e+10 Active_file_bytes:1.33842944e+09 AnonHugePages_bytes:2.968518656e+10 AnonPages_bytes:3.184646144e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840201728e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7000392704e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:507904 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03390208e+08 Inactive_file_bytes:4.86088704e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.27315968e+08 MemAvailable_bytes:1.2727046144e+10 MemFree_bytes:1.5094554624e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.3042304e+07 SReclaimable_bytes:8.6331392e+07 SUnreclaim_bytes:1.18407168e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.0473856e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:44.86633+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.24 2023-07-21T17:18:20.26757+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:44.87531+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.363716421, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:44.82526+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:44.8528+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:44.82681+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:44.84772+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.24 2023-07-21T17:18:20.2826+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=29.978652837, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:20.28835+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:44.8556+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.339673099, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:20.61982+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:18:44.88446+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.060313913, err="couldn't get SNTP reply: read udp 127.0.0.1:13093->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:44.88788+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=37.020382331, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:44.84978+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.317541686, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:44.88977+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001459736, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:44.88978+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:44.98929+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.24 2023-07-21T17:18:45.08203+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:45.13068+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.2174538752e+10 Active_bytes:3.3513209856e+10 Active_file_bytes:1.338671104e+09 AnonHugePages_bytes:2.9691478016e+10 AnonPages_bytes:3.217573888e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.84045568e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.724507136e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:143360 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03406592e+08 Inactive_file_bytes:4.86105088e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.2736512e+08 MemAvailable_bytes:1.2390703104e+10 MemFree_bytes:1.4758084608e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.9133056e+07 SReclaimable_bytes:8.6335488e+07 SUnreclaim_bytes:1.19058432e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.0539392e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:45.14032+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.24 2023-07-21T17:18:45.12319+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:45.29752+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.21 2023-07-21T17:18:45.26173+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.2175284224e+10 Active_bytes:3.3513955328e+10 Active_file_bytes:1.338671104e+09 AnonHugePages_bytes:2.9691478016e+10 AnonPages_bytes:3.2176295936e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.84045568e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7245595648e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:143360 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03406592e+08 Inactive_file_bytes:4.86105088e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.2736512e+08 MemAvailable_bytes:1.238984704e+10 MemFree_bytes:1.4757228544e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.9133056e+07 SReclaimable_bytes:8.6335488e+07 SUnreclaim_bytes:1.19058432e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.0539392e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:45.32979+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:45.53074+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:45.52903+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000917838, err="couldn't get SNTP reply: read udp 127.0.0.1:47296->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:45.53041+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.641132945, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:17:53.54848+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:45.71883+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:45.71999+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:20.62155+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T17:18:45.72686+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.976948562, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:45.73081+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.24 2023-07-21T17:18:45.73216+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:45.77622+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:45.77725+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:45.98644+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:46.2428+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:45.7882+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.305219846, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:46.24368+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:46.2369+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:45.99796+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.219666944e+10 Active_bytes:3.3535352832e+10 Active_file_bytes:1.338683392e+09 AnonHugePages_bytes:2.9699866624e+10 AnonPages_bytes:3.2199073792e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840467968e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7268140032e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:155648 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03402496e+08 Inactive_file_bytes:4.86100992e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.27373312e+08 MemAvailable_bytes:1.2367536128e+10 MemFree_bytes:1.473490944e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.9563136e+07 SReclaimable_bytes:8.6339584e+07 SUnreclaim_bytes:1.19103488e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.05443072e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:45.77321+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:46.24335+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:46.24151+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T17:18:48.17334+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.93002048, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:46.41206+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:24.85952+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T17:18:48.71573+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:47.03639+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:24.87041+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:24.87539+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:49.03279+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.309855674, err="couldn't get SNTP reply: read udp 127.0.0.1:35165->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:24.86655+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:49.03597+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.378365511, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T17:18:49.21118+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.174929867, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:20.80224+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:20.80231+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:20.80246+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=30.283300077, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T17:18:20.80222+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:49.88381+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:49.9641+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:49.88171+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:50.09471+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:49.48664+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:50.24698+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.059780739, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:50.24707+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=26.462719196, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:49.56928+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.2235020288e+10 Active_bytes:3.3573728256e+10 Active_file_bytes:1.338707968e+09 AnonHugePages_bytes:2.9693575168e+10 AnonPages_bytes:3.2239550464e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840492544e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7301334016e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:180224 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03402496e+08 Inactive_file_bytes:4.86100992e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.27373312e+08 MemAvailable_bytes:1.232709632e+10 MemFree_bytes:1.4694457344e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:9.0185728e+07 SReclaimable_bytes:8.6339584e+07 SUnreclaim_bytes:1.19169024e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.05508608e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:24.66175+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:20.80357+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:20.80508+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:20.80519+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:20.81279+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T17:18:50.29423+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:25.10632+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:25.15831+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T17:18:57.27341+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=75.220897256, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:57.30749+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:20:39.51076+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:19:18.66626+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:20:39.52147+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=62.76 2023-07-21T17:20:39.61389+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=38.84 2023-07-21T17:20:39.61691+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=34.86 2023-07-21T17:18:33.06736+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.73 2023-07-21T17:18:50.34865+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:25.26668+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T17:18:25.1582+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:50.37042+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:25.26913+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:25.27273+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1947698176e+10 Active_bytes:3.328618496e+10 Active_file_bytes:1.338486784e+09 AnonHugePages_bytes:2.9701963776e+10 AnonPages_bytes:3.1937462272e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840263168e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.707762688e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:389120 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03390208e+08 Inactive_file_bytes:4.86088704e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.27320064e+08 MemAvailable_bytes:1.2626939904e+10 MemFree_bytes:1.4994419712e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.4512768e+07 SReclaimable_bytes:8.6331392e+07 SUnreclaim_bytes:1.18513664e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04845056e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:25.3621+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:25.27119+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=31.17316724, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:25.27137+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:25.3549+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:20.81199+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:50.37081+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=47.914001941, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T17:18:50.50109+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.624037378, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T17:18:25.272+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1930699776e+10 Active_bytes:3.326918656e+10 Active_file_bytes:1.338486784e+09 AnonHugePages_bytes:2.9701963776e+10 AnonPages_bytes:3.1931465728e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:1.840263168e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7058228224e+10 DirectMap2M_bytes:5.040504832e+10 DirectMap4k_bytes:1.13442816e+09 Dirty_bytes:389120 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7301504e+07 Inactive_bytes:5.03390208e+08 Inactive_file_bytes:4.86088704e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.27320064e+08 MemAvailable_bytes:1.264384e+10 MemFree_bytes:1.5011319808e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.4512768e+07 SReclaimable_bytes:8.6331392e+07 SUnreclaim_bytes:1.18513664e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.04845056e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T17:18:50.41171+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.519032625, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T17:18:50.97193+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:50.97314+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:50.972+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:50.97353+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:25.7471+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:50.97218+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:25.6377+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:50.97219+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:50.97441+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001142383, err="couldn't get SNTP reply: read udp 127.0.0.1:34371->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:25.53361+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:50.97201+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:25.79233+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:50.97979+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:25.81337+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T17:18:25.63594+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:26.06656+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:26.24329+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T17:18:26.20081+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:26.0877+08:00 WARN [26106,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T17:18:27.0264+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T17:18:26.49221+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:26.76695+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T17:18:27.22949+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:27.37751+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.739640093, err="couldn't get SNTP reply: read udp 127.0.0.1:17326->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T17:18:27.21659+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T17:18:27.48167+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:27.4804+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:27.49091+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T17:18:27.57291+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=41.97 2023-07-21T17:18:27.74691+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:27.86882+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T17:18:27.9429+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:27.48268+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T17:18:28.01391+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:28.09389+08:00 WARN [26106,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T17:18:28.20387+08:00 INFO [26106,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.206028038, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T17:18:28.20401+08:00 WARN [26106,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T17:18:28.2082+08:00 ERROR [26106,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:01.53387+08:00 INFO [13914,] caller=sdk/sdk_init.go:43:InitSDK: init sdk conf {ConfigPropertiesDir:conf/config_properties ModuleConfigDir:conf/module_config CryptoPath:conf/.config_secret.key CryptoMethod:plain} 2023-07-21T22:31:01.5373+08:00 INFO [13914,] caller=config/config_reader_writer.go:218:loadYamlFilesFromPath: read config files from path /home/admin/obagent/conf/config_properties 2023-07-21T22:31:01.538+08:00 INFO [13914,] caller=config/config_reader_writer.go:224:loadYamlFilesFromPath: read config from path /home/admin/obagent/conf/config_properties, files length 2 2023-07-21T22:31:01.5923+08:00 INFO [13914,] caller=config/config_reader_writer.go:218:loadYamlFilesFromPath: read config files from path /home/admin/obagent/conf/module_config 2023-07-21T22:31:01.59303+08:00 INFO [13914,] caller=config/config_reader_writer.go:224:loadYamlFilesFromPath: read config from path /home/admin/obagent/conf/module_config, files length 6 2023-07-21T22:31:01.67141+08:00 INFO [13914,] caller=monagent/main.go:100:runMonitorAgent: sdk inited 2023-07-21T22:31:01.67292+08:00 INFO [13914,] caller=sdk/monagent_callbacks.go:104:func8: module monagent.admin.basic.auth init config sucessfully 2023-07-21T22:31:01.67438+08:00 INFO [13914,] caller=sdk/monagent_callbacks.go:73:func5: module monagent.server.basic.auth init config sucessfully 2023-07-21T22:31:01.68215+08:00 WARN [13914,] caller=engine/pipeline_module_callback.go:115:InitPipelineModuleCallback: pipeline module monitor.ob.log is inactive, just skip 2023-07-21T22:31:01.68692+08:00 WARN [13914,] caller=engine/pipeline_module_callback.go:115:InitPipelineModuleCallback: pipeline module monitor.mysql is inactive, just skip 2023-07-21T22:31:01.9872+08:00 INFO [13914,] caller=mysql/table_input.go:144:Init: table input init with config&{0 0xc0000a4f40 map[ob_is_rootservice:false ob_is_v3:false ob_is_v4:false ob_svr_ip:172.118.81.152 ob_svr_port:2882] [0xc00020b900 0xc00020b980 0xc00020ba00 0xc00020ba80 0xc00020bb00 0xc00020bb80 0xc00020bc00 0xc00020bc80 0xc00020bd00 0xc00020bd80 0xc00020be00 0xc00020be80 0xc00020bf00 0xc00020bf80 0xc000120080 0xc000120100] 4} 2023-07-21T22:31:02.0028+08:00 INFO [13914,] caller=mysql/table_input.go:161:Init: successfully init mysql table input plugin 2023-07-21T22:31:02.00455+08:00 INFO [13914,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:OB ob_cluster_id:20230720 ob_cluster_name:obce-3zones obzone:zone2 svr_ip:172.118.81.152]} 2023-07-21T22:31:02.00527+08:00 INFO [13914,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T22:31:02.09193+08:00 INFO [13914,] caller=mysql/table_input.go:144:Init: table input init with config&{0 0xc0000a54e0 map[ob_is_rootservice:false ob_is_v3:false ob_is_v4:false ob_svr_ip:172.118.81.152 ob_svr_port:2882] [0xc000121100 0xc000121180 0xc000121200 0xc000121280 0xc000121300 0xc000121380 0xc000121400 0xc000121880 0xc000121900 0xc000121980 0xc000121a00 0xc000121a80 0xc000121b00 0xc000121b80] 4} 2023-07-21T22:31:02.12008+08:00 INFO [13914,] caller=mysql/table_input.go:161:Init: successfully init mysql table input plugin 2023-07-21T22:31:02.1222+08:00 INFO [13914,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:OB ob_cluster_id:20230720 ob_cluster_name:obce-3zones obzone:zone2 svr_ip:172.118.81.152]} 2023-07-21T22:31:02.12726+08:00 INFO [13914,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T22:31:02.12766+08:00 INFO [13914,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/ob/basic 2023-07-21T22:31:02.14075+08:00 INFO [13914,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/ob/extra 2023-07-21T22:31:02.14663+08:00 INFO [13914,] caller=engine/pipeline_module_callback.go:33:addPipeline: add pipeline module result succeed 2023-07-21T22:31:02.16819+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=info, fields.msg="Parsed flag --collector.filesystem.mount-points-exclude", flag="^/(dev|proc|sys|var/lib/docker/.+)($|/)" 2023-07-21T22:31:02.1688+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=info, fields.msg="Parsed flag --collector.filesystem.fs-types-exclude", flag="^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$" 2023-07-21T22:31:02.18218+08:00 INFO [13914,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:HOST svr_ip:172.118.81.152]} 2023-07-21T22:31:02.18297+08:00 INFO [13914,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T22:31:02.18325+08:00 INFO [13914,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/node/host 2023-07-21T22:31:02.18367+08:00 INFO [13914,] caller=engine/pipeline_module_callback.go:33:addPipeline: add pipeline module result succeed 2023-07-21T22:31:02.55475+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:02.55572+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:02.58901+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_partition 2023-07-21T22:31:02.64432+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:02.64972+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:02.65067+08:00 INFO [13914,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_partition 2023-07-21T22:31:02.6911+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_plan_cache 2023-07-21T22:31:02.65075+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:02.63358+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server 2023-07-21T22:31:02.70356+08:00 INFO [13914,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server 2023-07-21T22:31:02.70645+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:02.7594+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:02.8306+08:00 WARN [13914,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T22:31:02.90946+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:31:02.9845+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) QUERY_TIMEOUT(100000000) */ tenant_name, 1 as role, case when cnt is null then 0 else cnt end as cnt from (select __all_tenant.tenant_name, t1.cnt from __all_tenant left join (select tenant_id, count(*) as cnt from __all_virtual_partition_info where svr_ip = ? and svr_port = ? group by tenant_id) t1 on __all_tenant.tenant_id = t1.tenant_id) t2 2023-07-21T22:31:03.14405+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ group_concat(svr_ip SEPARATOR ',') as servers, status, count(1) as cnt from __all_server group by status 2023-07-21T22:31:03.29808+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T22:31:03.37923+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T22:31:03.48695+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:03.50275+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=8.2 2023-07-21T22:31:03.51195+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.004139127, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:03.51144+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=12.92 2023-07-21T22:31:03.52138+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=16.1 2023-07-21T22:31:03.52455+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.03777144, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:03.53309+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.003423111, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:03.5354+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.006235626, err="couldn't get SNTP reply: read udp 127.0.0.1:43972->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:03.53993+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:03.54059+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:03.54288+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:03.55698+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:03.58488+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=8.2 2023-07-21T22:31:03.58572+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=12.92 2023-07-21T22:31:03.60297+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=16.1 2023-07-21T22:31:03.5479+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:03.95315+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:03.95501+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:04.01057+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:04.0107+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.463029821, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:03.9548+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:04.0836+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T22:31:03.68641+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.077019937, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:04.08615+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.513087967, err="couldn't get SNTP reply: read udp 127.0.0.1:28243->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:04.0106+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.465330748, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:04.30432+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:31:04.08608+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:31:04.01091+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1061303296e+10 Active_bytes:3.2524730368e+10 Active_file_bytes:1.463427072e+09 AnonHugePages_bytes:2.9697769472e+10 AnonPages_bytes:3.1059673088e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.018553856e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.650789376e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:192512 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56752896e+08 Inactive_file_bytes:5.39447296e+08 KernelStack_bytes:2.3576576e+07 Mapped_bytes:1.30891776e+08 MemAvailable_bytes:1.3441794048e+10 MemFree_bytes:1.571756032e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.2646656e+07 SReclaimable_bytes:9.146368e+07 SUnreclaim_bytes:1.190912e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.1055488e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:04.34641+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:04.34766+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.730268446, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:04.11907+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:31:04.38131+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:04.40766+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:04.41904+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:04.41962+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:04.38784+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:04.0113+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:04.53726+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T22:31:04.54795+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:04.55713+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:04.55769+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:04.55826+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:04.566+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:04.55652+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:31:04.58386+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:04.58487+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:04.58222+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:04.5865+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:04.58722+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:04.58754+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.054554018, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:04.56981+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:31:04.59626+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_disk 2023-07-21T22:31:04.58539+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:04.70264+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:04.70379+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:31:04.58569+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:04.58442+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:05.00039+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:05.00501+08:00 INFO [13914,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_disk 2023-07-21T22:31:05.1636+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:04.60514+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:05.01208+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.468757599, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:07.57303+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:05.01471+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:31:06.61881+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:04.81767+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:07.59068+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:31:06.26621+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:06.14818+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:04.82719+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:06.61403+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_disk 2023-07-21T22:31:06.14894+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:31:04.59123+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:07.08038+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:04.59246+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:06.46942+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:04.82048+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:07.18044+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:31:08.0018+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:07.58238+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.981127478, err="couldn't get SNTP reply: read udp 127.0.0.1:20686->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:08.10923+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ total_size, free_size from __all_virtual_disk_stat where svr_ip = ? and svr_port = ? 2023-07-21T22:31:05.17644+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:06.59735+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:06.61847+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:06.61784+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:08.00316+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.753976714, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:08.42431+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:13.95083+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T22:31:13.95776+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:13.95896+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:13.95976+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:08.49843+08:00 INFO [13914,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_disk 2023-07-21T22:31:13.96092+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:13.96973+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:13.97102+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:13.97784+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:13.978+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:13.97885+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:04.59392+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:14.38663+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:14.48199+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:31:08.69537+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:08.49873+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1063912448e+10 Active_bytes:3.252733952e+10 Active_file_bytes:1.463427072e+09 AnonHugePages_bytes:2.9697769472e+10 AnonPages_bytes:3.1061901312e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.018553856e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.650789376e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:192512 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56752896e+08 Inactive_file_bytes:5.39447296e+08 KernelStack_bytes:2.3576576e+07 Mapped_bytes:1.30891776e+08 MemAvailable_bytes:1.343873024e+10 MemFree_bytes:1.5714496512e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.2646656e+07 SReclaimable_bytes:9.146368e+07 SUnreclaim_bytes:1.190912e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.1055488e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:08.84043+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:31:08.69456+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:14.60007+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:14.59937+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.017530638, err="couldn't get SNTP reply: read udp 127.0.0.1:34015->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:14.60117+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:08.69527+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=21.72 2023-07-21T22:31:14.60308+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=15.64 2023-07-21T22:31:14.61705+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=16.96 2023-07-21T22:31:14.61793+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.923191864, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:13.97734+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:14.52576+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.025385039, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:14.85602+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:14.86908+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:14.87268+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:14.752+08:00 INFO [13914,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T22:31:07.64247+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:07.64869+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:08.66884+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:31:14.66954+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.407394017, err="couldn't get SNTP reply: read udp 127.0.0.1:48065->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:08.4046+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:31:09.40374+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T22:31:13.97961+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.287850983, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:14.54316+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=8.270645673, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:15.03173+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:14.87947+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:08.93865+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=21.72 2023-07-21T22:31:15.00223+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ total_size, free_size from __all_virtual_disk_stat where svr_ip = ? and svr_port = ? 2023-07-21T22:31:08.88945+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T22:31:14.73626+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T22:31:15.31755+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:15.29796+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:15.49303+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:15.41427+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:15.49369+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:15.55533+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=24.38 2023-07-21T22:31:16.44448+08:00 WARN [13914,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T22:31:15.68301+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.624093526, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:16.43152+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:16.42245+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=15.64 2023-07-21T22:31:16.44524+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:16.38106+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1172481024e+10 Active_bytes:3.2636153856e+10 Active_file_bytes:1.463672832e+09 AnonHugePages_bytes:2.97271296e+10 AnonPages_bytes:3.1161233408e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.018852864e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6709515264e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:520192 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56773376e+08 Inactive_file_bytes:5.39467776e+08 KernelStack_bytes:2.3691264e+07 Mapped_bytes:1.31874816e+08 MemAvailable_bytes:1.3323276288e+10 MemFree_bytes:1.5598903296e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.3859072e+07 SReclaimable_bytes:9.1480064e+07 SUnreclaim_bytes:1.19087104e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10567168e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:15.56667+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:16.45151+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=16.96 2023-07-21T22:31:16.38136+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:31:16.39467+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:16.45166+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:16.45826+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=7.9727806900000004, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:16.44644+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:16.45821+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:16.39239+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=12.589720545, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:16.45982+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:15.04878+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:16.46279+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:31:16.44749+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:16.45616+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:15.71716+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1131496448e+10 Active_bytes:3.259502592e+10 Active_file_bytes:1.463529472e+09 AnonHugePages_bytes:2.9718740992e+10 AnonPages_bytes:3.113129984e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.018656256e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6675121152e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:315392 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.567488e+08 Inactive_file_bytes:5.394432e+08 KernelStack_bytes:2.3691264e+07 Mapped_bytes:1.31760128e+08 MemAvailable_bytes:1.3366771712e+10 MemFree_bytes:1.5642484736e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.3633792e+07 SReclaimable_bytes:9.1471872e+07 SUnreclaim_bytes:1.19017472e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10489344e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:16.44844+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:16.44788+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=16.3 2023-07-21T22:31:16.45815+08:00 WARN [13914,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T22:31:16.44728+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T22:31:16.4645+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:16.46343+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:16.46933+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.419741654, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:16.47192+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.56 2023-07-21T22:31:16.47819+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=7.72373536, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:16.57483+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:16.67544+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:16.46983+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:16.67587+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=17.17 2023-07-21T22:31:16.67804+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:31:16.71086+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:31:16.71502+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:31:16.71546+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:31:16.71526+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:31:16.67573+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T22:31:16.87179+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:16.8723+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:31:16.74836+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.281796337, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:16.71563+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.121350656e+10 Active_bytes:3.2677249024e+10 Active_file_bytes:1.463742464e+09 AnonHugePages_bytes:2.9725032448e+10 AnonPages_bytes:3.1191076864e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.018906112e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6718579712e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:331776 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56785664e+08 Inactive_file_bytes:5.39480064e+08 KernelStack_bytes:2.3691264e+07 Mapped_bytes:1.31964928e+08 MemAvailable_bytes:1.328195584e+10 MemFree_bytes:1.5557537792e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4088448e+07 SReclaimable_bytes:9.148416e+07 SUnreclaim_bytes:1.19054336e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10538496e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:204800]" 2023-07-21T22:31:17.12026+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:16.89933+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.33 2023-07-21T22:31:17.1475+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:17.1479+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T22:31:17.12057+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:17.15114+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T22:31:17.1534+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.041350382, err="couldn't get SNTP reply: read udp 127.0.0.1:4940->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:17.18158+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:17.14779+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T22:31:17.18238+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:17.18219+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:17.19731+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.158418393, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:17.29077+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T22:31:17.28407+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001010486, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:17.32576+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.853322117, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:17.19705+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:17.32115+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=17.82 2023-07-21T22:31:17.35686+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.88683878, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:17.33769+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:31:17.34074+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:17.34075+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:17.42976+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:17.43131+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:17.46282+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:17.46361+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:17.47342+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:17.48332+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.434229574, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:17.51164+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:31:17.51248+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:31:17.47555+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:17.52508+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:17.52577+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:17.53129+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:17.53896+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:17.53922+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.123816569, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:17.5579+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:31:17.56682+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:31:17.58463+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:17.58592+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:31:17.5945+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.210951093, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:17.6227+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:31:17.62339+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:31:17.62379+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:31:17.62408+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:31:17.62441+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:31:17.63059+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:31:17.89734+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:17.90021+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:17.9658+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:17.93089+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:17.98419+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:17.90095+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.56 2023-07-21T22:31:17.98439+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:18.0879+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.33 2023-07-21T22:31:18.09666+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=17.82 2023-07-21T22:31:18.0975+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.204091886, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:18.09763+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:18.09476+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1236534272e+10 Active_bytes:3.270039552e+10 Active_file_bytes:1.463861248e+09 AnonHugePages_bytes:2.9733421056e+10 AnonPages_bytes:3.1232278528e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.019024896e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6710621184e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:454656 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56785664e+08 Inactive_file_bytes:5.39480064e+08 KernelStack_bytes:2.3691264e+07 Mapped_bytes:1.3201408e+08 MemAvailable_bytes:1.3256486912e+10 MemFree_bytes:1.5532007424e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4305536e+07 SReclaimable_bytes:9.148416e+07 SUnreclaim_bytes:1.19054336e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10538496e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:18.09833+08:00 WARN [13914,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T22:31:18.0998+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.132251544, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:18.08908+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:18.10074+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:18.10131+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:31:09.48314+08:00 WARN [13914,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T22:31:18.10959+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:06.78569+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.729146002, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:09.39667+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T22:31:18.11165+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:18.11156+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00059049, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:18.11237+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:18.11303+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:18.11348+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:18.11392+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:18.11413+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:18.11489+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:18.08788+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:18.11216+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.11098368e+10 Active_bytes:3.25733376e+10 Active_file_bytes:1.4635008e+09 AnonHugePages_bytes:2.9714546688e+10 AnonPages_bytes:3.1109697536e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.018627584e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.664822272e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:270336 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.567488e+08 Inactive_file_bytes:5.394432e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.31698688e+08 MemAvailable_bytes:1.338933248e+10 MemFree_bytes:1.5665061888e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.3449472e+07 SReclaimable_bytes:9.1467776e+07 SUnreclaim_bytes:1.19025664e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.1049344e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:18.11183+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:18.11596+08:00 WARN [13914,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T22:31:07.98602+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:18.11676+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:18.11487+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:13.93024+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:18.11928+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:18.1216+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.56 2023-07-21T22:31:18.11556+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:18.11895+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:18.11499+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002308805, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:18.12282+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:18.08433+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:31:09.51644+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T22:31:13.94505+08:00 INFO [13914,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T22:31:18.08659+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000815157, err="couldn't get SNTP reply: read udp 127.0.0.1:53325->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:14.78498+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:08.83015+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:31:14.16341+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:14.17157+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:31:14.14436+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:18.11958+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:14.17625+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.83828805, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:14.17756+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T22:31:14.17857+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=0, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=89884.54, old_value=89885.84 2023-07-21T22:31:13.59558+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T22:31:14.33029+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:14.33027+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.775894748, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:14.33036+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:14.32969+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:14.33061+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:18.1213+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:31:18.12085+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.524767509, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:18.08919+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:18.12317+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.33 2023-07-21T22:31:18.1252+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.4472740330000002, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:18.12483+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:14.34922+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.56819701, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:14.12872+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:31:14.33116+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:18.12463+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:18.12485+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.013781297, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:18.13043+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:18.14178+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001837898, err="couldn't get SNTP reply: read udp 127.0.0.1:16398->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:18.14281+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.246197014, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:18.16546+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:31:18.29058+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:31:18.33851+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T22:31:18.32607+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:18.29032+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:31:18.29323+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T22:31:18.59491+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T22:31:18.60925+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.608698705, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:18.63472+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:18.64222+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T22:31:18.56805+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:18.56101+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:18.56109+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:18.60798+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T22:31:18.89429+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:18.70283+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.115015131, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:18.98715+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=0, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=7100.36, old_value=7100.49 2023-07-21T22:31:18.88699+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:19.07922+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:18.70675+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:31:19.20523+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:18.87861+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:19.20724+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T22:31:18.60184+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:18.70159+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:19.35852+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=17.82 2023-07-21T22:31:19.2434+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:19.35825+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T22:31:19.21702+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:19.50728+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=15.519194424, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:31:19.37129+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:19.56868+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:19.3748+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:31:19.64279+08:00 INFO [13914,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T22:31:19.3683+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1245852672e+10 Active_bytes:3.270971392e+10 Active_file_bytes:1.463861248e+09 AnonHugePages_bytes:2.9733421056e+10 AnonPages_bytes:3.1241191424e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.019024896e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6712189952e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:454656 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56785664e+08 Inactive_file_bytes:5.39480064e+08 KernelStack_bytes:2.3691264e+07 Mapped_bytes:1.3201408e+08 MemAvailable_bytes:1.324742656e+10 MemFree_bytes:1.5522947072e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4305536e+07 SReclaimable_bytes:9.148416e+07 SUnreclaim_bytes:1.19054336e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10538496e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:19.36842+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:19.65326+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:19.6485+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.569354552, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:19.67454+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:31:19.65466+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.56 2023-07-21T22:31:19.67444+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.152241317, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:08.90136+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:31:19.67177+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:19.67503+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.043926937, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:19.68157+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:19.68155+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:19.68575+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:19.68451+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:19.6862+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:19.68447+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:19.68198+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:17.19104+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:17.20733+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:17.20642+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:22.39958+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:31:22.40174+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:22.98099+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:22.97952+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:22.98203+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.065078767, err="couldn't get SNTP reply: read udp 127.0.0.1:29132->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:23.11514+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:23.11641+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:31:23.11647+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:23.16884+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:31:23.18086+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:23.19427+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:23.11659+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:31:23.06879+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1310688256e+10 Active_bytes:3.2774647808e+10 Active_file_bytes:1.463959552e+09 AnonHugePages_bytes:2.9746003968e+10 AnonPages_bytes:3.1322587136e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.019119104e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6746182656e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:548864 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56781568e+08 Inactive_file_bytes:5.39475968e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32042752e+08 MemAvailable_bytes:1.31801088e+10 MemFree_bytes:1.5455584256e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5186176e+07 SReclaimable_bytes:9.1488256e+07 SUnreclaim_bytes:1.19054336e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10542592e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:23.20771+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:22.22218+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:23.23928+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ cpu_total,cpu_assigned,mem_total,mem_assigned,disk_total,disk_assigned,unit_num,migrating_unit_num,cpu_assigned_percent, mem_assigned_percent, disk_assigned_percent from __all_virtual_server_stat where svr_ip = ? and svr_port = ? 2023-07-21T22:31:23.23939+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T22:31:23.20988+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.087051248, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:17.30968+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:23.50575+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:23.52398+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:23.3674+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:23.36804+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.129770654, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:23.53991+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:23.71546+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.377381425, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:23.72664+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:23.55572+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=34.64 2023-07-21T22:31:23.71338+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:23.76685+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:23.55465+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:24.03672+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:23.73891+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:24.00827+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:24.52856+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:23.76866+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.279667955, err="couldn't get SNTP reply: read udp 127.0.0.1:18247->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:24.99224+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:24.7765+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:25.00225+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:31:25.06448+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T22:31:25.90666+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:25.95058+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:25.58648+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:17.63131+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:31:25.94861+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:25.6011+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.362285759, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:25.95327+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:25.95248+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:25.95152+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:25.9698+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.2827134, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:26.02397+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:26.05945+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:26.06416+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.33 2023-07-21T22:31:26.13484+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:26.06142+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:26.19335+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:26.12276+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:26.06198+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:26.28555+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:26.13677+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:26.34927+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:26.37361+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:26.3489+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:26.43856+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.008988511, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:26.43796+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.021159586, err="couldn't get SNTP reply: read udp 127.0.0.1:52060->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:27.56205+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:27.56685+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:27.85978+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:27.86295+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:27.90359+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:27.89561+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:31:28.01409+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:28.23005+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.65606069, err="couldn't get SNTP reply: read udp 127.0.0.1:4982->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:28.23542+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:28.46562+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:28.42626+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:28.46575+08:00 WARN [13914,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T22:31:28.46748+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.064368838, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:28.41576+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.861518116, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:31:28.55943+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:27.85972+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:28.75745+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.739712657, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:28.23522+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:28.78816+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.399520702, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:28.55523+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:28.79645+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:28.79894+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=17.82 2023-07-21T22:31:28.79977+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:28.8006+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:28.80489+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:28.80535+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:28.89191+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:28.82519+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:28.93841+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:28.93448+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:28.89182+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:28.93441+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=9.280240412, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:28.94378+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:28.93392+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:28.94856+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:28.93986+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:28.89272+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:31:28.95137+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:28.96568+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:31:28.96838+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:28.96652+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:28.89259+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:29.02216+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:29.03317+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:29.03977+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:29.04064+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:29.04106+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:29.04155+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:31:29.04121+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:29.0414+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:29.161+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:29.04066+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:31:29.04225+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:29.24566+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:31:29.27746+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:29.27698+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:31:29.27769+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:31:29.24654+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:29.33987+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.173237604, err="couldn't get SNTP reply: read udp 127.0.0.1:54311->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:29.36999+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:31:29.37042+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:29.3696+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:31:29.3708+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:29.37171+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:31:29.37197+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:29.37104+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:29.41073+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:31:29.37243+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000512904, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:29.37218+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:31:29.41252+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:29.38859+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:29.41088+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.102061708, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:29.54685+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.79 2023-07-21T22:31:29.54761+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.646140552, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:29.55573+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:29.58248+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:29.58278+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:29.54809+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.9 2023-07-21T22:31:29.5324+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:31:29.5855+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.01 2023-07-21T22:31:29.58625+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:31:29.58639+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.055821347, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:29.58461+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:29.5322+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:29.58332+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:31:29.58679+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:31:29.56986+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:29.59071+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:31:29.592+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:29.50442+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:31:29.59205+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:31:29.59264+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:29.61199+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:31:29.61245+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:31:29.6129+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:31:29.5778+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.166825244, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:29.66516+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:31:29.50467+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:31:29.64859+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:29.8038+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:31:29.57586+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1372320768e+10 Active_bytes:3.2836370432e+10 Active_file_bytes:1.464049664e+09 AnonHugePages_bytes:2.9729226752e+10 AnonPages_bytes:3.1365787648e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.01924608e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6777279488e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:671744 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56818432e+08 Inactive_file_bytes:5.39512832e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.3211648e+08 MemAvailable_bytes:1.3120647168e+10 MemFree_bytes:1.5396052992e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.6644352e+07 SReclaimable_bytes:9.1492352e+07 SUnreclaim_bytes:1.19087104e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10579456e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:29.82009+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:29.87115+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:31:29.58053+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=24.962986396, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:31:29.95255+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:31:29.95381+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:29.93159+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:31:29.95888+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:31:29.95935+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:31:29.95619+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:29.95546+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.813028033, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:29.9538+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:31:29.9611+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:31:29.96015+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:29.88926+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:31:29.95991+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:31:30.01271+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:30.016+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:31:30.05816+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:29.96076+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=26.283753863, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:31:30.09945+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:30.12606+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:31:30.01668+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.714529866, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:31:30.13231+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.751800695, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:30.1097+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:30.10813+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T22:31:30.17303+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:31:30.1351+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:31:29.70135+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:31:30.38379+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:31:30.42542+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:31:30.21001+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:30.42797+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:31:30.49193+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:31:30.49288+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T22:31:30.51123+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T22:31:30.52284+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:31:30.48314+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:31:30.56809+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:31:30.56896+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:31:30.56883+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:30.56994+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T22:31:30.58174+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:31:30.58273+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:31:30.58351+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:31:30.63605+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:31:30.63695+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T22:31:30.65693+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T22:31:30.42589+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:30.68831+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.217522453, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:30.69114+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T22:31:30.69116+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:30.73137+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:30.73586+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:30.66091+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:30.86187+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:30.86293+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:30.86372+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:30.56994+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:30.69186+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:30.97116+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.322425973, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:30.97303+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:31:30.73784+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:30.97632+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:31:30.97078+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T22:31:30.97791+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:31:30.97873+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:31:30.69188+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T22:31:30.85485+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:30.98306+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:31:30.97916+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.79 2023-07-21T22:31:31.00729+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:30.98023+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.115376946, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:30.8618+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:31.22124+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:31.02455+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:31.0143+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:31.28693+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.027452106, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:31.28722+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:31.28824+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:31:31.08167+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=32.92 2023-07-21T22:31:31.28982+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:31.32483+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:31.02157+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T22:31:30.98525+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:31.51485+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.085548415, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:31.45365+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:31.50467+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T22:31:31.01365+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.005297123, err="couldn't get SNTP reply: read udp 127.0.0.1:62377->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:31.00078+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:31.14525+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.105213833, err="couldn't get SNTP reply: read udp 127.0.0.1:58713->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:31.14487+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:31:31.14849+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T22:31:32.38398+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:32.48699+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:32.49162+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:32.48168+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.07551596, err="couldn't get SNTP reply: read udp 127.0.0.1:25400->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:32.48682+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T22:31:31.23698+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.060651589, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:31.14643+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:32.5056+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T22:31:31.33676+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.96 2023-07-21T22:31:32.50635+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T22:31:32.50663+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:32.50645+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.04 2023-07-21T22:31:31.52068+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.204973197, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T22:31:32.20091+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.601024325, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:32.51303+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.48520311, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:32.51434+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:31.08176+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:32.51745+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:32.51769+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:32.52377+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:32.52556+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:32.17765+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:31.67993+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:31.02339+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:32.3883+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:32.29854+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:31.03185+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:31.02472+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:31:31.03028+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.014670171, err="couldn't get SNTP reply: read udp 127.0.0.1:55508->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:32.4862+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=32.92 2023-07-21T22:31:31.08192+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.9 2023-07-21T22:31:32.54093+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:32.5444+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:32.54738+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:31:32.54706+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:32.54607+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.96 2023-07-21T22:31:32.56374+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.165018956, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:32.5471+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.01 2023-07-21T22:31:32.61095+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.7465588300000001, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:32.61285+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:31:32.56553+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.04 2023-07-21T22:31:32.62404+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.235066484, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:32.62738+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:31:32.62758+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:32.69396+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:31:32.60783+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:32.86882+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:31:32.86978+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:31:32.87421+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:31:32.69401+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:32.9513+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:32.88697+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.8682450130000001, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:32.88709+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:33.0067+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:33.00795+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:33.00873+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:33.01034+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=29.156548462, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T22:31:33.00668+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:33.01159+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:31:33.16517+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:33.1661+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:19.73733+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:19.68871+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:19.97157+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:31:19.97246+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000725533, err="couldn't get SNTP reply: read udp 127.0.0.1:54135->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:33.21942+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:20.33767+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:19.97598+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:20.47073+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:20.47226+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:33.21932+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.69401444, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:20.47207+08:00 WARN [13914,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T22:31:20.50137+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:34.25138+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:34.51149+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T22:31:34.51175+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ cpu_total,cpu_assigned,mem_total,mem_assigned,disk_total,disk_assigned,unit_num,migrating_unit_num,cpu_assigned_percent, mem_assigned_percent, disk_assigned_percent from __all_virtual_server_stat where svr_ip = ? and svr_port = ? 2023-07-21T22:31:34.56137+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:34.56309+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:31:34.57629+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.968993711, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:34.57684+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:34.57951+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:34.58418+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:31:34.57992+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.49363285, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:34.67305+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:34.67315+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:34.7139+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T22:31:34.68541+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=16.558417144, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:34.73698+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:34.73493+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:34.74004+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T22:31:34.87161+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:31:21.31314+08:00 INFO [13914,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T22:31:21.31247+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:31:34.83509+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=9.258759791, err="couldn't get SNTP reply: read udp 127.0.0.1:14259->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:34.87119+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:21.01757+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:34.74816+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1416696832e+10 Active_bytes:3.2881410048e+10 Active_file_bytes:1.464713216e+09 AnonHugePages_bytes:2.97271296e+10 AnonPages_bytes:3.1417839616e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.020114432e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.680329728e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:1.37216e+06 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56888064e+08 Inactive_file_bytes:5.39582464e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32141056e+08 MemAvailable_bytes:1.3072801792e+10 MemFree_bytes:1.534783488e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.7897728e+07 SReclaimable_bytes:9.1512832e+07 SUnreclaim_bytes:1.19144448e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.1065728e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:35.01256+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T22:31:35.42222+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T22:31:35.42057+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:31:35.41702+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.443049129, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:35.42845+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T22:31:35.72702+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:35.72569+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:35.72764+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:21.01281+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1294255104e+10 Active_bytes:3.2758198272e+10 Active_file_bytes:1.463943168e+09 AnonHugePages_bytes:2.9741809664e+10 AnonPages_bytes:3.1294066688e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.01910272e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6727656448e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:532480 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56781568e+08 Inactive_file_bytes:5.39475968e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32038656e+08 MemAvailable_bytes:1.3200408576e+10 MemFree_bytes:1.5475892224e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.49568e+07 SReclaimable_bytes:9.1488256e+07 SUnreclaim_bytes:1.19046144e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.105344e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:36.21825+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:36.13136+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:36.21822+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:36.27742+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:36.37472+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:36.38309+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:36.24329+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.10309816, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:36.28869+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:36.3832+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:36.38329+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:36.9767+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:36.97439+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:36.38382+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:36.76156+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.37 2023-07-21T22:31:36.37495+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:36.95983+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00739998, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:36.95057+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.96438662, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:36.97734+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:36.9804+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:36.95442+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:37.01937+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:37.01781+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:36.98025+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00608389, err="couldn't get SNTP reply: read udp 127.0.0.1:18958->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:37.03265+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:37.03317+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.648386045, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:37.01849+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:37.03487+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:37.03551+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:37.0358+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:36.97988+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=19.91 2023-07-21T22:31:37.06101+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.35 2023-07-21T22:31:37.03268+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=16.024160758, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:36.9689+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:36.3846+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:31:37.07195+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.589598291, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:36.94348+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.555243118, err="couldn't get SNTP reply: read udp 127.0.0.1:41555->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:37.07321+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=16.054944988, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:37.0734+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:37.07467+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:37.07281+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:31:36.99135+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:37.0813+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:37.0842+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:37.08187+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.37 2023-07-21T22:31:37.19194+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:31:37.19237+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:37.19966+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.620047171, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:37.32125+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:37.32596+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:37.33055+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:37.33133+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.970612569, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:37.34951+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:31:37.37202+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:31:37.40773+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:31:37.43923+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:31:37.44254+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T22:31:37.48558+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T22:31:37.48633+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T22:31:37.48686+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T22:31:37.4878+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T22:31:33.3275+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=32.92 2023-07-21T22:31:20.93061+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:37.55053+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:37.55113+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:37.55165+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:21.30681+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:21.40715+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:31:20.72547+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:20.92023+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:37.55575+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:31:21.29299+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:31:20.92587+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:33.43658+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:21.01649+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=34.64 2023-07-21T22:31:20.9324+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:21.02221+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:21.46223+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:20.9291+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.304113245, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:37.55229+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:21.49018+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.218558892, err="couldn't get SNTP reply: read udp 127.0.0.1:26937->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:21.02231+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:21.01595+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002911307, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:21.33748+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:21.46204+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:20.7922+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.005078672, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:21.29542+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=34.64 2023-07-21T22:31:20.93075+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:31:21.33757+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:21.49641+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:21.62634+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:21.67246+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=34.64 2023-07-21T22:31:21.67257+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:31:37.49798+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:37.55013+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.96 2023-07-21T22:31:21.67421+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:31:21.674+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:37.49805+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:21.67564+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:22.26799+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:37.55957+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1339200512e+10 Active_bytes:3.280316416e+10 Active_file_bytes:1.463963648e+09 AnonHugePages_bytes:2.973761536e+10 AnonPages_bytes:3.1332630528e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.019135488e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.676348416e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:565248 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56793856e+08 Inactive_file_bytes:5.39488256e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32042752e+08 MemAvailable_bytes:1.3154320384e+10 MemFree_bytes:1.5429787648e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5411456e+07 SReclaimable_bytes:9.1488256e+07 SUnreclaim_bytes:1.19046144e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.105344e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:37.64642+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.046332194, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:37.88472+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:31:37.88244+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.37 2023-07-21T22:31:38.52016+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.094035662, err="couldn't get SNTP reply: read udp 127.0.0.1:9509->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:38.52143+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1461433344e+10 Active_bytes:3.2926400512e+10 Active_file_bytes:1.464967168e+09 AnonHugePages_bytes:2.9729226752e+10 AnonPages_bytes:3.1463530496e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.020220928e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6837289984e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:811008 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56847104e+08 Inactive_file_bytes:5.39541504e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.3242368e+08 MemAvailable_bytes:1.302530048e+10 MemFree_bytes:1.5300222976e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9081472e+07 SReclaimable_bytes:9.1516928e+07 SUnreclaim_bytes:1.19287808e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10804736e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:38.51925+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:38.60871+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:38.69166+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.383426395, err="couldn't get SNTP reply: read udp 127.0.0.1:38686->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:38.6897+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:38.69174+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:38.88353+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:38.6481+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:38.99949+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:39.2337+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:38.62653+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:39.19209+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.778563416, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:39.49329+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.970258672, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:39.45038+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:39.4888+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:39.13304+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.377766859, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:31:39.59524+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.3260904, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:40.09956+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.04 2023-07-21T22:31:39.45671+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1464423424e+10 Active_bytes:3.2929435648e+10 Active_file_bytes:1.465012224e+09 AnonHugePages_bytes:2.9729226752e+10 AnonPages_bytes:3.1464747008e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.02027008e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6839387136e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:860160 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.568512e+08 Inactive_file_bytes:5.395456e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.32427776e+08 MemAvailable_bytes:1.3024182272e+10 MemFree_bytes:1.5299072e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9327232e+07 SReclaimable_bytes:9.1537408e+07 SUnreclaim_bytes:1.1931648e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10853888e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:40.13589+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:40.13717+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.1375+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:40.19727+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:31:40.13717+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:40.13673+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:40.19797+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=19.91 2023-07-21T22:31:40.20238+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.20195+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=16.955653823, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:40.32529+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.8562625499999998, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:40.19582+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:40.2109+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=15.168702044, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:40.20684+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:40.38634+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.38843+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:40.3898+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.38853+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:40.38823+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:40.3909+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:40.38805+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.35 2023-07-21T22:31:40.38817+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:40.38824+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:40.39206+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:40.39249+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:40.38887+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:40.39255+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.37 2023-07-21T22:31:40.38998+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:31:40.40232+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.005700424, err="couldn't get SNTP reply: read udp 127.0.0.1:60776->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:40.39444+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.40783+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.40937+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00449716, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:40.40929+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.41063+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.39561+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:40.39903+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.52094513, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:40.39218+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.3994+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.81 2023-07-21T22:31:40.41077+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=19.91 2023-07-21T22:31:40.40521+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:31:40.42506+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.35 2023-07-21T22:31:40.41093+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.007651315, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:40.40505+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:40.42533+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.42526+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:40.49302+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=17.98 2023-07-21T22:31:40.51233+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:40.49477+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.49495+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.039175585, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:40.51224+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:31:40.512+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.51263+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.37 2023-07-21T22:31:40.51369+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:31:40.5214+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:31:40.52078+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:40.52291+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:31:40.51257+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.5665+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:31:40.56771+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:31:40.52073+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:40.53047+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.56876+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.050153991, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:40.60092+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.60099+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:31:40.60184+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.60379+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:31:40.60415+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.57525+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:40.60501+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.204768584, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:40.60788+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:40.61277+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=19.91 2023-07-21T22:31:40.6131+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:40.56644+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.5997+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:31:40.61629+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:31:40.6162+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.51634+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=17.26981743, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:40.61763+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=19.274100152, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:40.61703+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:31:40.61515+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.35 2023-07-21T22:31:40.61664+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:31:40.60472+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:31:40.61989+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:31:40.62019+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:31:40.61279+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:40.62156+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:31:40.62324+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:31:40.62395+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:31:40.62467+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:31:40.62121+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:31:40.61325+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.224508563, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:40.63106+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.129501226, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:40.6188+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:31:40.63331+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:31:40.63432+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:31:40.63491+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:40.63558+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:31:40.63674+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:31:40.63736+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:40.638+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:31:40.72659+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:31:40.72706+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:31:40.72761+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:31:40.63005+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:31:40.73314+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:31:40.73527+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:31:40.88135+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:31:40.88206+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T22:31:26.45476+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:40.89116+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:31:41.09728+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:31:41.09801+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T22:31:41.0988+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T22:31:41.10357+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T22:31:41.13848+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T22:31:41.13907+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T22:31:41.02467+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:26.45639+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:41.18673+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:41.374+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:41.37506+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:41.37665+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:41.08525+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.135332352e+10 Active_bytes:3.28173568e+10 Active_file_bytes:1.46403328e+09 AnonHugePages_bytes:2.9733421056e+10 AnonPages_bytes:3.1357407232e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.0192256e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6759977984e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:651264 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56793856e+08 Inactive_file_bytes:5.39488256e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32100096e+08 MemAvailable_bytes:1.3138448384e+10 MemFree_bytes:1.5413874688e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.6509184e+07 SReclaimable_bytes:9.1492352e+07 SUnreclaim_bytes:1.19087104e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10579456e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:41.42386+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.42 2023-07-21T22:31:41.45894+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=20.19 2023-07-21T22:31:40.88538+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:41.44268+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:40.94268+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:41.08725+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.42 2023-07-21T22:31:41.6119+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:41.58073+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:41.64283+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:41.71146+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.500421997, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:41.76102+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:41.76487+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:41.76525+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T22:31:42.43205+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:42.45956+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000982904, err="couldn't get SNTP reply: read udp 127.0.0.1:41651->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:42.60776+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:42.61224+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:43.12831+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=15.587756695, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:43.19824+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:43.19861+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:43.26288+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:43.40381+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:43.41131+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1509979136e+10 Active_bytes:3.2975392768e+10 Active_file_bytes:1.465413632e+09 AnonHugePages_bytes:2.9735518208e+10 AnonPages_bytes:3.150989312e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.020671488e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6869062656e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:1.241088e+06 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.5687168e+08 Inactive_file_bytes:5.3956608e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.32452352e+08 MemAvailable_bytes:1.2976123904e+10 MemFree_bytes:1.5250796544e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9876096e+07 SReclaimable_bytes:9.1541504e+07 SUnreclaim_bytes:1.1933696e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10878464e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:42.76146+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.45 2023-07-21T22:31:43.46751+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.24164874, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:43.41158+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.081638275, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:43.46763+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:43.1255+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.152453632e+10 Active_bytes:3.2989937664e+10 Active_file_bytes:1.465401344e+09 AnonHugePages_bytes:2.9754392576e+10 AnonPages_bytes:3.1526383616e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.0206592e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6887412736e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:1.24928e+06 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56875776e+08 Inactive_file_bytes:5.39570176e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.32448256e+08 MemAvailable_bytes:1.2959051776e+10 MemFree_bytes:1.5233728512e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9847424e+07 SReclaimable_bytes:9.1541504e+07 SUnreclaim_bytes:1.19332864e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10874368e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:43.46887+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.107213277, err="couldn't get SNTP reply: read udp 127.0.0.1:22674->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:43.46903+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.068607143, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:31:26.59817+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:45.9568+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.963204522, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:26.97204+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.938855763, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:43.55818+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:43.55741+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:26.51048+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:43.6316+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:26.51564+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T22:31:43.71778+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:26.5989+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:26.73615+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.711128223, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:26.51581+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:31:43.77951+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:43.75626+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:27.05789+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:27.08224+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:31:27.082+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T22:31:43.72806+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:43.73716+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:27.08141+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:27.08174+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T22:31:43.81337+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=17.036968683, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:43.89814+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.187205919, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:43.84153+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:43.84129+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.015305204, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:43.90944+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:43.90971+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:26.59691+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=33.79 2023-07-21T22:31:43.83956+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:43.84187+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.42 2023-07-21T22:31:43.91051+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:43.91921+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.263021887, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T22:31:43.9098+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:27.1307+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:47.51491+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:27.47925+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T22:31:43.92195+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:27.47987+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T22:31:27.41576+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T22:31:43.92188+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:45.12114+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:45.12132+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:45.51178+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:45.53476+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:45.66326+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:45.68213+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:45.9511+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:45.9514+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.42 2023-07-21T22:31:45.95697+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:45.51161+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.133124819, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:47.51533+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:46.10319+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.091108655, err="couldn't get SNTP reply: read udp 127.0.0.1:5588->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:46.10867+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.295873646, err="couldn't get SNTP reply: read udp 127.0.0.1:12722->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:46.15852+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.42 2023-07-21T22:31:46.21623+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:46.11616+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:46.82943+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:46.16666+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:46.10939+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:47.07771+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:47.24992+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:46.15971+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:47.23375+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:45.68125+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T22:31:46.1925+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:47.34707+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:47.36189+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:47.36718+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:47.37099+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:47.36308+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:47.37292+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.188529574, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:47.37632+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:47.44787+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.022254175, err="couldn't get SNTP reply: read udp 127.0.0.1:51609->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:47.47304+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:47.47694+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:47.39509+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.266063632, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:47.47302+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:47.39248+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:47.49092+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.155562496e+10 Active_bytes:3.302125568e+10 Active_file_bytes:1.46563072e+09 AnonHugePages_bytes:2.973761536e+10 AnonPages_bytes:3.155513344e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.020900864e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6890198016e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:1.470464e+06 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.5689216e+08 Inactive_file_bytes:5.3958656e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.3246464e+08 MemAvailable_bytes:1.2929048576e+10 MemFree_bytes:1.5203602432e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0543744e+07 SReclaimable_bytes:9.1541504e+07 SUnreclaim_bytes:1.19373824e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10915328e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:47.46002+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1546171392e+10 Active_bytes:3.3011777536e+10 Active_file_bytes:1.465606144e+09 AnonHugePages_bytes:2.9735518208e+10 AnonPages_bytes:3.1544610816e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.02088448e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6886003712e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:1.45408e+06 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56900352e+08 Inactive_file_bytes:5.39594752e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.32452352e+08 MemAvailable_bytes:1.2939747328e+10 MemFree_bytes:1.5214309376e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0441344e+07 SReclaimable_bytes:9.1541504e+07 SUnreclaim_bytes:1.19361536e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.1090304e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:47.39479+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.154960384e+10 Active_bytes:3.301523456e+10 Active_file_bytes:1.46563072e+09 AnonHugePages_bytes:2.973761536e+10 AnonPages_bytes:3.154956288e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.020900864e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6887052288e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:1.470464e+06 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.5689216e+08 Inactive_file_bytes:5.3958656e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.3246464e+08 MemAvailable_bytes:1.2936708096e+10 MemFree_bytes:1.5211261952e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0543744e+07 SReclaimable_bytes:9.1541504e+07 SUnreclaim_bytes:1.19373824e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10915328e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:45.98373+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:45.64661+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=36.42 2023-07-21T22:31:47.77281+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:47.83585+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:47.95329+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:47.96868+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:47.97113+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:47.97406+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:47.97474+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:47.97207+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:47.97506+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=18.9 2023-07-21T22:31:47.97509+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=20.19 2023-07-21T22:31:47.97433+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:47.97758+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:47.97794+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.523864481, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:47.97875+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:48.5001+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T22:31:48.53645+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:51.17246+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:48.01119+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:48.01194+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:48.01731+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:48.19551+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:48.20876+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:47.9816+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:47.97926+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:48.44321+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:48.44592+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:48.22459+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:48.3545+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:48.46024+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:48.46277+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=20.19 2023-07-21T22:31:48.47296+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=20.19 2023-07-21T22:31:48.49616+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:48.47429+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:48.49649+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=30.383833872, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:31:48.4961+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:48.49661+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=40.47 2023-07-21T22:31:48.5033+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:48.7535+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=17.311211137, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:48.50756+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:50.83961+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:48.55389+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:48.56251+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.455108634, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:48.55405+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:48.63252+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.019738895, err="couldn't get SNTP reply: read udp 127.0.0.1:62883->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:48.63268+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.577245436, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:48.63392+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.5376114640000003, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:48.65894+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=20.19 2023-07-21T22:31:48.68755+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:48.68839+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000351581, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:48.73516+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:48.71846+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002260495, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:48.68806+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:31:48.74573+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:48.73164+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:48.66053+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:48.73122+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.064983484, err="couldn't get SNTP reply: read udp 127.0.0.1:11951->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:48.74672+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:48.73146+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:48.74665+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.023710767, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:51.44368+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:49.30131+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=40.47 2023-07-21T22:31:48.68798+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1386038272e+10 Active_bytes:3.2850137088e+10 Active_file_bytes:1.464098816e+09 AnonHugePages_bytes:2.9729226752e+10 AnonPages_bytes:3.1388127232e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.019291136e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6778491904e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:716800 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56814336e+08 Inactive_file_bytes:5.39508736e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32128768e+08 MemAvailable_bytes:1.3106282496e+10 MemFree_bytes:1.538166784e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.692288e+07 SReclaimable_bytes:9.1492352e+07 SUnreclaim_bytes:1.19128064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10620416e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:48.75924+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1380819968e+10 Active_bytes:3.2844918784e+10 Active_file_bytes:1.464098816e+09 AnonHugePages_bytes:2.9729226752e+10 AnonPages_bytes:3.138422784e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.019291136e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6776394752e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:716800 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56814336e+08 Inactive_file_bytes:5.39508736e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32128768e+08 MemAvailable_bytes:1.311082496e+10 MemFree_bytes:1.5386210304e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.692288e+07 SReclaimable_bytes:9.1492352e+07 SUnreclaim_bytes:1.19128064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10620416e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:49.45753+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=19.395357344, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:49.45258+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:49.48795+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:49.68119+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:49.32632+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:49.77746+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001128664, err="couldn't get SNTP reply: read udp 127.0.0.1:42096->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:49.77725+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1272398848e+10 Active_bytes:3.2736329728e+10 Active_file_bytes:1.46393088e+09 AnonHugePages_bytes:2.973761536e+10 AnonPages_bytes:3.1273525248e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.019094528e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6722675712e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:524288 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56781568e+08 Inactive_file_bytes:5.39475968e+08 KernelStack_bytes:2.3691264e+07 Mapped_bytes:1.3203456e+08 MemAvailable_bytes:1.3220438016e+10 MemFree_bytes:1.549592576e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4641408e+07 SReclaimable_bytes:9.1488256e+07 SUnreclaim_bytes:1.19046144e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.105344e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:49.8089+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=40.47 2023-07-21T22:31:49.9629+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:31:49.98219+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.051780637, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:49.45139+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1381938176e+10 Active_bytes:3.2846036992e+10 Active_file_bytes:1.464098816e+09 AnonHugePages_bytes:2.9729226752e+10 AnonPages_bytes:3.138422784e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.019291136e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.677691904e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:716800 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56814336e+08 Inactive_file_bytes:5.39508736e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32128768e+08 MemAvailable_bytes:1.3110001664e+10 MemFree_bytes:1.5385387008e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.692288e+07 SReclaimable_bytes:9.1492352e+07 SUnreclaim_bytes:1.19128064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10620416e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:49.80303+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:49.98709+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:50.13851+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:50.13875+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:50.14103+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:50.13995+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:50.13961+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:50.14157+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:50.15875+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:50.25319+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.018588313, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:50.13747+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:50.40674+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.3426909390000001, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:50.40703+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.153456746, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:50.43823+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:50.30844+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:50.43103+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=18.054378025, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:50.40443+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:50.31616+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:50.40582+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.01 2023-07-21T22:31:50.46232+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:50.37875+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:50.58147+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:50.6109+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:51.09429+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.155405596, err="couldn't get SNTP reply: read udp 127.0.0.1:63259->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:51.30265+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:51.23829+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:51.25069+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:51.27193+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:51.27181+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:51.43866+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:51.5107+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:51.3907+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T22:31:51.5093+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:51.51119+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:51.52301+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:51.4468+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:51.32477+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.862498754, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:51.53538+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:51.53861+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.45 2023-07-21T22:31:51.53756+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:51.53918+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:51.53541+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:51.55386+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.45 2023-07-21T22:31:51.55646+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:51.55667+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=21.3 2023-07-21T22:31:51.91239+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.45 2023-07-21T22:31:51.81508+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:51.95598+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:31:51.95978+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:51.95745+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:51.96267+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:51.9623+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.024803182, err="couldn't get SNTP reply: read udp 127.0.0.1:56490->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:51.95276+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:51.96304+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.010127837, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:51.96657+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:51.99166+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:51.99349+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=21.3 2023-07-21T22:31:52.0024+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:52.00788+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1652712448e+10 Active_bytes:3.311880192e+10 Active_file_bytes:1.466089472e+09 AnonHugePages_bytes:2.974810112e+10 AnonPages_bytes:3.1654080512e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.021367808e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6942696448e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:1.04448e+06 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56904448e+08 Inactive_file_bytes:5.39598848e+08 KernelStack_bytes:2.3740416e+07 Mapped_bytes:1.32493312e+08 MemAvailable_bytes:1.2827877376e+10 MemFree_bytes:1.5102189568e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.1833984e+07 SReclaimable_bytes:9.1557888e+07 SUnreclaim_bytes:1.19484416e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11042304e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:52.0814+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:51.97584+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:52.08244+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:52.10195+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:52.09509+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=21.3 2023-07-21T22:31:52.10223+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.012992965, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:52.09515+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:52.10391+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=32.41380037, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:52.10521+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.215869854, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:52.10271+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:52.10552+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:31:52.13549+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.112651822, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:52.15308+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:52.10641+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:52.14017+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:52.21263+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=25.622324455, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:52.21171+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:52.21376+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:52.15227+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.145444796, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:52.2135+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:52.21263+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:20.62525+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:21.31359+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.06595135, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:20.73157+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:52.22005+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:20.78994+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.032560018, err="couldn't get SNTP reply: read udp 127.0.0.1:37320->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:20.53738+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:31:52.21608+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:52.22386+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:52.2233+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:20.58834+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:20.59245+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001025952, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:52.25624+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:52.25633+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:52.32781+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:52.32706+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:52.315+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:52.32721+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:20.60269+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:52.34444+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=40.27 2023-07-21T22:31:52.3478+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.619799302, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:52.33324+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:52.35064+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:52.35933+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:52.35942+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=7.3084828250000005, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:52.36084+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:52.38287+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=40.27 2023-07-21T22:31:52.3464+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:52.36252+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:52.36402+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000746853, err="couldn't get SNTP reply: read udp 127.0.0.1:9734->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:52.41694+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.072790971, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:52.43381+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.005805146, err="couldn't get SNTP reply: read udp 127.0.0.1:52617->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:52.35463+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1664832512e+10 Active_bytes:3.313092608e+10 Active_file_bytes:1.466093568e+09 AnonHugePages_bytes:2.974810112e+10 AnonPages_bytes:3.1666274304e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.021371904e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.695036416e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:1.048576e+06 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56904448e+08 Inactive_file_bytes:5.39598848e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.32493312e+08 MemAvailable_bytes:1.2817854464e+10 MemFree_bytes:1.5092154368e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.1866752e+07 SReclaimable_bytes:9.1574272e+07 SUnreclaim_bytes:1.19484416e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11058688e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:52.47049+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:52.70885+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.033726401, err="couldn't get SNTP reply: read udp 127.0.0.1:54192->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:52.72592+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.007402105, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:52.42161+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.056680618, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:52.4924+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:52.71034+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.004900059, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:52.77953+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:52.69001+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:52.77741+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=40.27 2023-07-21T22:31:52.70132+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=14.258079145, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T22:31:52.76433+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:52.9218+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:52.80855+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:31:52.9235+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:52.77958+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1679152128e+10 Active_bytes:3.3145266176e+10 Active_file_bytes:1.466114048e+09 AnonHugePages_bytes:2.974810112e+10 AnonPages_bytes:3.167291392e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.021400576e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6965044224e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:1.077248e+06 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56904448e+08 Inactive_file_bytes:5.39598848e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.32509696e+08 MemAvailable_bytes:1.280479232e+10 MemFree_bytes:1.5079084032e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.1989632e+07 SReclaimable_bytes:9.1574272e+07 SUnreclaim_bytes:1.19484416e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11058688e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:52.92417+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:52.8306+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.82 2023-07-21T22:31:52.68935+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.166992384e+10 Active_bytes:3.3136037888e+10 Active_file_bytes:1.466114048e+09 AnonHugePages_bytes:2.974810112e+10 AnonPages_bytes:3.1670124544e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.021400576e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6953509888e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:1.077248e+06 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56904448e+08 Inactive_file_bytes:5.39598848e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.32509696e+08 MemAvailable_bytes:1.2813082624e+10 MemFree_bytes:1.5087374336e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.1989632e+07 SReclaimable_bytes:9.1574272e+07 SUnreclaim_bytes:1.19484416e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11058688e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:53.77192+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:52.3356+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:53.70722+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:53.69581+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.82 2023-07-21T22:31:53.06725+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=8.003549724, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:53.77727+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T22:31:53.24145+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:53.31194+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:53.40151+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=18.82 2023-07-21T22:31:53.86042+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:53.72695+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.807263719, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:53.38904+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:31:53.40088+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:53.4012+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:53.44938+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:53.79347+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:53.79388+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:53.77567+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:53.79536+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:53.79922+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:53.7978+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:53.85716+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:53.858+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:53.85924+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:53.85948+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:53.86034+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:54.94275+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:53.88718+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:31:55.10785+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.746557412, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:55.02326+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:53.88636+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:31:53.89007+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:53.92346+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=21.58 2023-07-21T22:31:54.05763+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:54.05783+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:54.08179+08:00 WARN [13914,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:31:54.08185+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:54.08157+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:54.06089+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:54.08136+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:54.11474+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=21.58 2023-07-21T22:31:54.11428+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:54.11451+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:54.11938+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:54.45352+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:54.46762+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:54.2257+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:54.52468+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:54.52593+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.180999554, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:54.52784+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=21.58 2023-07-21T22:31:54.52793+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:54.82736+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:54.54005+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:54.5283+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:54.53328+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:31:54.82724+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.290656345, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:54.52785+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:54.85671+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:54.83154+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:54.85866+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:54.94434+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:53.8865+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:31:56.1698+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:56.10687+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.217396177, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:31:53.92022+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:55.10669+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.529181176, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:55.15272+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.773205589, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:55.18123+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:55.18337+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:32:00.27533+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:55.14663+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:55.18109+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:55.30858+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:55.14192+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:31:33.20505+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=13.517187481, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T22:31:55.31757+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:55.32041+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:55.31846+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:33.1932+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:55.31001+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=23.403966359, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:31:33.21628+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=16.033684369, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:31:33.19131+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:31:55.3318+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:55.45763+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:55.56657+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:55.5685+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:03.70193+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:32:13.79431+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.326871228, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:32:13.79529+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:20.36878+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:20.35335+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:20.33869+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:55.67961+08:00 INFO [13914,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:31:20.36036+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:31:20.35359+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:55.66285+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.127156456, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:31:55.87443+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:58.90504+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:33.4336+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:58.91399+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:31:33.36179+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:33.49268+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:34.73614+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:58.91554+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:33.20282+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:31:21.30701+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=0, fields.level=debug, fields.msg="CPU System counter jumped backwards", new_value=3030.91, old_value=3031.33 2023-07-21T22:31:58.91593+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.081048377, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:31:20.40639+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:58.91753+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.225697, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:58.91764+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:58.91909+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:58.91939+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:31:58.92221+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:58.9223+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:58.92529+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:58.92307+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1755104256e+10 Active_bytes:3.3221275648e+10 Active_file_bytes:1.466171392e+09 AnonHugePages_bytes:2.9762781184e+10 AnonPages_bytes:3.1756230656e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.021482496e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7004857344e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:1.159168e+06 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.56937216e+08 Inactive_file_bytes:5.39631616e+08 KernelStack_bytes:2.3724032e+07 Mapped_bytes:1.32517888e+08 MemAvailable_bytes:1.2726775808e+10 MemFree_bytes:1.5001018368e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2796544e+07 SReclaimable_bytes:9.1582464e+07 SUnreclaim_bytes:1.19443456e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.1102592e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:31:20.46172+08:00 WARN [13914,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:31:58.92549+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:58.92722+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:58.9309+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=38.81 2023-07-21T22:31:33.44228+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:31:33.4364+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:33.69249+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:31:58.93737+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:33.44857+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.629279914, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:32:13.79127+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.132766585, err="couldn't get SNTP reply: read udp 127.0.0.1:39342->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:31:58.93736+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:31:33.51713+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.012082364, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:33.44921+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=9.862266419000001, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:31:33.62326+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:31:33.63625+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:31:33.50985+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:31:33.59661+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:31:58.94245+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.025766362, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:32:00.73271+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.485635762, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:32:02.74103+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:02.80427+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:02.80472+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:03.15502+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.71 2023-07-21T22:32:03.19744+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:00.73208+08:00 WARN [13914,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:03.19304+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:32:03.48537+08:00 ERROR [13914,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:32:03.49558+08:00 INFO [13914,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=39.71 2023-07-21T22:32:45.93603+08:00 INFO [14040,] caller=sdk/sdk_init.go:43:InitSDK: init sdk conf {ConfigPropertiesDir:conf/config_properties ModuleConfigDir:conf/module_config CryptoPath:conf/.config_secret.key CryptoMethod:plain} 2023-07-21T22:32:45.93947+08:00 INFO [14040,] caller=config/config_reader_writer.go:218:loadYamlFilesFromPath: read config files from path /home/admin/obagent/conf/config_properties 2023-07-21T22:32:45.93996+08:00 INFO [14040,] caller=config/config_reader_writer.go:224:loadYamlFilesFromPath: read config from path /home/admin/obagent/conf/config_properties, files length 2 2023-07-21T22:32:45.97085+08:00 INFO [14040,] caller=config/config_reader_writer.go:218:loadYamlFilesFromPath: read config files from path /home/admin/obagent/conf/module_config 2023-07-21T22:32:45.97429+08:00 INFO [14040,] caller=config/config_reader_writer.go:224:loadYamlFilesFromPath: read config from path /home/admin/obagent/conf/module_config, files length 6 2023-07-21T22:32:46.08436+08:00 INFO [14040,] caller=monagent/main.go:100:runMonitorAgent: sdk inited 2023-07-21T22:32:46.08653+08:00 INFO [14040,] caller=sdk/monagent_callbacks.go:104:func8: module monagent.admin.basic.auth init config sucessfully 2023-07-21T22:32:46.09073+08:00 INFO [14040,] caller=sdk/monagent_callbacks.go:73:func5: module monagent.server.basic.auth init config sucessfully 2023-07-21T22:32:46.10926+08:00 WARN [14040,] caller=engine/pipeline_module_callback.go:115:InitPipelineModuleCallback: pipeline module monitor.mysql is inactive, just skip 2023-07-21T22:32:46.25299+08:00 INFO [14040,] caller=mysql/table_input.go:144:Init: table input init with config&{0 0xc0001275c0 map[ob_is_rootservice:false ob_is_v3:false ob_is_v4:false ob_svr_ip:172.118.81.152 ob_svr_port:2882] [0xc00012df00 0xc00012df80 0xc00019e000 0xc00019e080 0xc00019e100 0xc00019e180 0xc00019e280 0xc00019e300 0xc00019e380 0xc00019e500 0xc00019e580 0xc00019e600 0xc00019e680 0xc00019e700 0xc00019e780 0xc00019e800] 4} 2023-07-21T22:32:46.30072+08:00 INFO [14040,] caller=mysql/table_input.go:161:Init: successfully init mysql table input plugin 2023-07-21T22:32:46.3092+08:00 INFO [14040,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:OB ob_cluster_id:20230720 ob_cluster_name:obce-3zones obzone:zone2 svr_ip:172.118.81.152]} 2023-07-21T22:32:46.31062+08:00 INFO [14040,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T22:32:46.38965+08:00 INFO [14040,] caller=mysql/table_input.go:144:Init: table input init with config&{0 0xc00029e360 map[ob_is_rootservice:false ob_is_v3:false ob_is_v4:false ob_svr_ip:172.118.81.152 ob_svr_port:2882] [0xc000395080 0xc000395100 0xc000395180 0xc000395200 0xc000395400 0xc000395500 0xc000395580 0xc000395600 0xc000395680 0xc000395700 0xc000395780 0xc000395800 0xc000395880 0xc000395900] 4} 2023-07-21T22:32:46.40182+08:00 INFO [14040,] caller=mysql/table_input.go:161:Init: successfully init mysql table input plugin 2023-07-21T22:32:46.40379+08:00 INFO [14040,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:OB ob_cluster_id:20230720 ob_cluster_name:obce-3zones obzone:zone2 svr_ip:172.118.81.152]} 2023-07-21T22:32:46.40435+08:00 INFO [14040,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T22:32:46.40458+08:00 INFO [14040,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/ob/basic 2023-07-21T22:32:46.40493+08:00 INFO [14040,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/ob/extra 2023-07-21T22:32:46.40529+08:00 INFO [14040,] caller=engine/pipeline_module_callback.go:33:addPipeline: add pipeline module result succeed 2023-07-21T22:32:46.41597+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=info, fields.msg="Parsed flag --collector.filesystem.mount-points-exclude", flag="^/(dev|proc|sys|var/lib/docker/.+)($|/)" 2023-07-21T22:32:46.41666+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=info, fields.msg="Parsed flag --collector.filesystem.fs-types-exclude", flag="^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$" 2023-07-21T22:32:46.41983+08:00 INFO [14040,] caller=retag/retag.go:74:Init: retag processor init with config&{map[] map[] map[app:HOST svr_ip:172.118.81.152]} 2023-07-21T22:32:46.42036+08:00 INFO [14040,] caller=prometheus/prometheus.go:89:Init: prometheus exporter config : &{fmtText} 2023-07-21T22:32:46.42062+08:00 INFO [14040,] caller=route/monagent_route.go:40:RegisterPipelineRoute: register route /metrics/node/host 2023-07-21T22:32:46.42095+08:00 INFO [14040,] caller=engine/pipeline_module_callback.go:33:addPipeline: add pipeline module result succeed 2023-07-21T22:32:46.42782+08:00 WARN [14040,] caller=engine/pipeline_module_callback.go:115:InitPipelineModuleCallback: pipeline module monitor.ob.log is inactive, just skip 2023-07-21T22:32:46.54955+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:46.54998+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:46.62014+08:00 INFO [14040,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_partition 2023-07-21T22:32:46.62065+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:46.62119+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:46.62017+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_plan_cache 2023-07-21T22:32:46.72238+08:00 INFO [14040,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_partition 2023-07-21T22:32:46.7603+08:00 INFO [14040,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server 2023-07-21T22:32:46.81276+08:00 INFO [14040,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server 2023-07-21T22:32:46.76759+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:32:46.8662+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T22:32:46.83331+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:32:46.8923+08:00 WARN [14040,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T22:32:46.90723+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:32:47.03196+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:32:47.10247+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.014899869, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:32:47.39841+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:32:47.43609+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) QUERY_TIMEOUT(100000000) */ tenant_name, 1 as role, case when cnt is null then 0 else cnt end as cnt from (select __all_tenant.tenant_name, t1.cnt from __all_tenant left join (select tenant_id, count(*) as cnt from __all_virtual_partition_info where svr_ip = ? and svr_port = ? group by tenant_id) t1 on __all_tenant.tenant_id = t1.tenant_id) t2 2023-07-21T22:32:47.35354+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.36 2023-07-21T22:32:47.51031+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:32:47.40558+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ group_concat(svr_ip SEPARATOR ',') as servers, status, count(1) as cnt from __all_server group by status 2023-07-21T22:32:47.51239+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:32:47.51275+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.45 2023-07-21T22:32:47.51427+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=21.4 2023-07-21T22:32:47.51589+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:32:47.5217+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.362163124, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:32:47.52731+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:32:47.52881+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:32:47.53009+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:32:47.53252+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:47.53658+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:32:47.54199+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:47.64406+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:47.725+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.199403179, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:32:47.72569+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:47.72623+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:47.7267+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:47.72723+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:47.72786+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:47.72798+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:32:47.72866+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.201143242, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:32:47.7295+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.189610354, err="couldn't get SNTP reply: read udp 127.0.0.1:29597->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:32:47.72444+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:48.44208+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:48.44173+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:47.64393+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:48.56102+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.784062096, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:32:48.83168+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:48.51053+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.36 2023-07-21T22:32:48.85236+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T22:32:48.85299+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:32:48.52006+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:32:48.83275+08:00 INFO [14040,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_disk 2023-07-21T22:32:48.85798+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.6022158690000001, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:32:48.83224+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:48.86228+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:48.86557+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.45 2023-07-21T22:32:48.86893+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=21.4 2023-07-21T22:32:48.86283+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:48.87005+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:48.87057+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:48.87105+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:48.87367+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.007817253, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:32:48.87478+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:32:48.87492+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.009723033, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:32:48.87563+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:32:48.8575+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:48.87771+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:48.88362+08:00 INFO [14040,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_disk 2023-07-21T22:32:48.8933+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:32:48.89407+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:32:48.89649+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:48.89724+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:48.98473+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:32:48.98544+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:32:48.96837+08:00 INFO [14040,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_disk 2023-07-21T22:32:48.97105+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.06523+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.10485+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:32:48.97127+08:00 INFO [14040,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:32:49.05746+08:00 INFO [14040,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_disk 2023-07-21T22:32:49.43735+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.43336+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.37331+08:00 INFO [14040,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T22:32:49.44114+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.44055+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.51309+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.5131+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.51373+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.51792+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.60198+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.60337+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:32:49.60544+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.60593+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.6124+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.6165+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.61738+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.61846+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.61921+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.62257+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.64409+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.64678+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.65808+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.69502+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.69589+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.69672+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.69734+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.69824+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.69876+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.69957+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.70003+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.70082+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.7122+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:49.71587+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu21, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:49.71647+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu21, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:50.06706+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.108456448e+10 Active_bytes:3.2562573312e+10 Active_file_bytes:1.478008832e+09 AnonHugePages_bytes:2.970615808e+10 AnonPages_bytes:3.108524032e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.033999872e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.661928448e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:221184 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.7309696e+07 Inactive_bytes:5.57621248e+08 Inactive_file_bytes:5.40311552e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.31612672e+08 MemAvailable_bytes:1.3411094528e+10 MemFree_bytes:1.5678869504e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.3142272e+07 SReclaimable_bytes:9.2004352e+07 SUnreclaim_bytes:1.18521856e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10526208e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:32:50.07956+08:00 INFO [14040,] caller=mysql/table_input.go:313:doCollect: no value found in cache, trigger update cache:ob_server_resource 2023-07-21T22:32:50.08571+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:32:50.08745+08:00 INFO [14040,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T22:32:50.09872+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.595204511, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:32:50.1213+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.7961152230000001, err="couldn't get SNTP reply: read udp 127.0.0.1:19391->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:32:50.12225+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.728437778, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:32:50.08567+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:32:50.13158+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:50.09926+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:50.22698+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:32:50.12284+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:32:50.49809+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.218278763, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:32:50.12704+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:50.50023+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:50.12701+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ total_size, free_size from __all_virtual_disk_stat where svr_ip = ? and svr_port = ? 2023-07-21T22:32:50.50592+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:50.50631+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:32:50.09921+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:50.50698+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:32:50.53309+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:32:50.53378+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:32:50.53432+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:32:50.12739+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:32:50.61257+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T22:32:50.68247+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:32:50.84569+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:32:50.87517+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:32:50.87594+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:32:50.87647+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:32:50.87707+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:32:50.8776+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:32:50.8309+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T22:32:50.90723+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:32:50.85278+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T22:32:50.90917+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T22:32:50.91577+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:32:50.91648+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:32:50.69798+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:50.6254+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:32:50.91764+08:00 WARN [14040,] caller=mysql/table_input.go:205:collectData: failed to do collect with sql:select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name[] Error 1146: Table 'oceanbase.V$OB_PLAN_CACHE_STAT' doesn't exist 2023-07-21T22:32:50.67724+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ total_size, free_size from __all_virtual_disk_stat where svr_ip = ? and svr_port = ? 2023-07-21T22:32:50.91693+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:32:50.91976+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:32:50.92042+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:32:50.92101+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:32:50.92661+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:32:50.92445+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1117713408e+10 Active_bytes:3.2595746816e+10 Active_file_bytes:1.478033408e+09 AnonHugePages_bytes:2.970615808e+10 AnonPages_bytes:3.1111950336e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034024448e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6656140288e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:245760 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57617152e+08 Inactive_file_bytes:5.40311552e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.316864e+08 MemAvailable_bytes:1.3376917504e+10 MemFree_bytes:1.5644680192e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.3293824e+07 SReclaimable_bytes:9.2004352e+07 SUnreclaim_bytes:1.18521856e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10526208e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:32:50.97261+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.662488272, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:32:50.97987+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:32:51.00586+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:32:50.98301+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:32:51.00791+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T22:32:50.49841+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:32:51.03804+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:32:51.06141+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T22:32:51.17149+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ cpu_total,cpu_assigned,mem_total,mem_assigned,disk_total,disk_assigned,unit_num,migrating_unit_num,cpu_assigned_percent, mem_assigned_percent, disk_assigned_percent from __all_virtual_server_stat where svr_ip = ? and svr_port = ? 2023-07-21T22:32:51.13554+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:32:51.16772+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ cpu_total,cpu_assigned,mem_total,mem_assigned,disk_total,disk_assigned,unit_num,migrating_unit_num,cpu_assigned_percent, mem_assigned_percent, disk_assigned_percent from __all_virtual_server_stat where svr_ip = ? and svr_port = ? 2023-07-21T22:32:51.19389+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:32:51.21684+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T22:32:51.21704+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T22:32:51.26561+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:32:51.22494+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T22:32:51.29183+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:51.30423+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:32:51.38792+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:32:51.41066+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:51.41269+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.49 2023-07-21T22:32:51.53953+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.9 2023-07-21T22:32:51.53966+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.129902867, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:32:51.5403+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.114836511, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:32:51.47966+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:51.59205+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T22:32:51.59227+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:32:51.54226+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.12043877, err="couldn't get SNTP reply: read udp 127.0.0.1:19314->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:32:51.61571+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:32:51.61409+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:32:51.59279+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T22:32:51.54014+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=21.59 2023-07-21T22:32:51.60563+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:32:51.59367+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:32:51.72519+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T22:32:51.74206+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T22:32:51.70387+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.49 2023-07-21T22:32:51.68245+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.258802344, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:32:51.77474+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:51.72621+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:51.74306+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.9 2023-07-21T22:32:51.87547+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:51.87738+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:51.88056+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:32:51.88116+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:32:51.9254+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:52.06465+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.445339374, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:32:52.06505+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:51.55336+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:52.06875+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:52.06897+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:52.06959+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:52.07007+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:52.07079+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:52.0655+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:51.88186+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:32:51.92635+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:52.09645+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:32:51.88088+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=21.59 2023-07-21T22:32:52.10199+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.448995339, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:32:52.07403+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:52.13402+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:52.07119+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:52.16223+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.23757312, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:32:52.05349+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.115859968e+10 Active_bytes:3.2636719104e+10 Active_file_bytes:1.478119424e+09 AnonHugePages_bytes:2.97271296e+10 AnonPages_bytes:3.1159631872e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034122752e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.668402176e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:344064 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57617152e+08 Inactive_file_bytes:5.40311552e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.3172736e+08 MemAvailable_bytes:1.3328355328e+10 MemFree_bytes:1.5596068864e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.3719808e+07 SReclaimable_bytes:9.2008448e+07 SUnreclaim_bytes:1.18444032e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.1045248e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:32:52.17003+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.444236669, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:32:52.09688+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001141021, err="couldn't get SNTP reply: read udp 127.0.0.1:54030->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:32:52.29487+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.203934979, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T22:32:52.2492+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:32:52.2698+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:52.31466+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:52.3156+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:52.31613+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:52.31518+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:32:52.18663+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:52.30019+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.004527648, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:32:54.24072+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:54.43573+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:32:54.43633+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T22:32:54.34467+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:32:52.32053+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:32:54.44054+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:53.26753+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:32:54.55716+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:32:54.88297+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:32:54.72883+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:54.49721+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:32:54.87198+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T22:32:55.12684+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:32:54.76732+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:53.26685+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T22:32:55.12654+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:32:53.26935+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:32:54.96968+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:55.12648+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T22:32:54.23925+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:54.49682+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:53.26793+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:54.23446+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:32:54.60564+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T22:32:55.35599+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:32:55.47353+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:32:55.37148+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:32:54.70001+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:32:54.60759+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:55.66169+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:32:55.66182+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:32:55.47373+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:32:56.21105+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:32:55.47365+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:32:56.19329+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:32:56.21278+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:32:56.19343+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.783468017, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:32:56.25021+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:56.24414+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:32:56.57696+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:56.52162+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:32:56.63333+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:32:56.63398+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:32:56.78154+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:32:56.7812+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:56.78309+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:53.26617+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:56.78401+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:32:56.82982+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:56.84135+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:56.8619+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:56.90067+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.03846+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:32:57.10087+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:32:57.1824+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.32699+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:57.32741+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:32:57.33368+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:57.33229+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.33661+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:32:57.33798+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:32:57.33981+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:32:57.33985+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.34192+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:57.34178+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:32:57.34143+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:32:57.51343+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.55809+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:32:57.55442+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:57.56484+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.56792+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.56934+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.57015+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.57116+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.57189+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.57296+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.5737+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.57475+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.57549+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.57633+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.57675+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.57739+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.57788+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.57845+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.5786+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.57899+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.57909+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.58001+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.58159+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.58299+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.58529+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.58377+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu22, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.58785+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:57.58699+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu22, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.58929+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:57.68764+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:57.68776+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:32:57.98362+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:32:57.98352+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:32:58.06388+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:32:58.06917+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:32:58.07383+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:57.58881+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.98494+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:32:57.58216+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:58.06173+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T22:32:58.11572+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:58.116+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T22:32:58.21947+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:58.22572+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:58.25828+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:32:58.36795+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:57.98261+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu23, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:58.26574+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:32:58.30899+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000867911, err="couldn't get SNTP reply: read udp 127.0.0.1:6544->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:32:58.70422+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:59.4018+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:58.99618+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.115285883, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:32:59.41654+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=52.13 2023-07-21T22:32:59.6554+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.84 2023-07-21T22:32:59.65595+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=21.61 2023-07-21T22:32:59.65635+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.240392935, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:32:59.64136+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.922349072, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:32:59.41643+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:32:59.64318+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T22:32:58.90474+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:32:59.65791+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=52.13 2023-07-21T22:32:59.65815+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:32:59.62903+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:59.40607+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:32:59.6277+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T22:32:59.62323+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:32:59.63105+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:32:59.73634+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:00.11472+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:33:00.11881+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T22:32:59.49201+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:32:59.42416+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:32:59.73801+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:59.65845+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.84 2023-07-21T22:32:59.96884+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.247705877, err="couldn't get SNTP reply: read udp 127.0.0.1:31637->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:32:59.65428+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:00.17507+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:32:59.66342+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:59.64535+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1222775808e+10 Active_bytes:3.2700981248e+10 Active_file_bytes:1.47820544e+09 AnonHugePages_bytes:2.9729226752e+10 AnonPages_bytes:3.1222525952e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034245632e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6702498816e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:430080 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.5762944e+08 Inactive_file_bytes:5.4032384e+08 KernelStack_bytes:2.3642112e+07 Mapped_bytes:1.31915776e+08 MemAvailable_bytes:1.3268307968e+10 MemFree_bytes:1.5535972352e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5026432e+07 SReclaimable_bytes:9.2008448e+07 SUnreclaim_bytes:1.18431744e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10440192e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:00.55657+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1216070656e+10 Active_bytes:3.2694263808e+10 Active_file_bytes:1.478193152e+09 AnonHugePages_bytes:2.9720838144e+10 AnonPages_bytes:3.1209496576e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034229248e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6700401664e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:409600 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57621248e+08 Inactive_file_bytes:5.40315648e+08 KernelStack_bytes:2.3642112e+07 Mapped_bytes:1.3182976e+08 MemAvailable_bytes:1.3275533312e+10 MemFree_bytes:1.5543209984e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.4530816e+07 SReclaimable_bytes:9.2008448e+07 SUnreclaim_bytes:1.18427648e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10436096e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:00.37792+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:00.64107+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:00.58481+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1223894016e+10 Active_bytes:3.2702099456e+10 Active_file_bytes:1.47820544e+09 AnonHugePages_bytes:2.9729226752e+10 AnonPages_bytes:3.1223640064e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034245632e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6703023104e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:430080 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.5762944e+08 Inactive_file_bytes:5.4032384e+08 KernelStack_bytes:2.3642112e+07 Mapped_bytes:1.31915776e+08 MemAvailable_bytes:1.3267505152e+10 MemFree_bytes:1.5535169536e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5026432e+07 SReclaimable_bytes:9.2008448e+07 SUnreclaim_bytes:1.18431744e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10440192e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:00.4384+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:00.81375+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=21.61 2023-07-21T22:33:01.07233+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:01.62554+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:33:01.63484+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.364634328, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:01.61552+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:01.20425+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:01.82786+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:01.82874+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:01.82958+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:01.83038+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:01.83119+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:01.0099+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00077286, err="couldn't get SNTP reply: read udp 127.0.0.1:52615->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:01.64088+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:01.62643+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:01.79277+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:01.64126+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:01.75638+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.044941179, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:01.85194+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:01.826+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.6058749089999997, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:01.84015+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:01.82232+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:33:01.91332+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:33:01.91608+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:01.90908+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:01.84159+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:01.93953+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:01.93983+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:01.9408+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:01.94067+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:01.94048+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:01.94082+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00085332, err="couldn't get SNTP reply: read udp 127.0.0.1:49239->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:01.91994+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:01.85207+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:01.84062+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:01.96358+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:01.96878+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:01.84089+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.318809836, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:01.94197+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:01.84124+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:01.84728+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:01.91236+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:02.00795+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:01.8418+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:02.00858+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:02.00931+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:02.01016+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.373745935, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:33:01.99174+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:02.00998+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:02.01172+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:02.00249+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:02.0133+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.039507553, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:33:01.98988+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:02.00955+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:02.01465+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.685406954, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:33:02.04153+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:33:02.05599+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:02.05748+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:02.05927+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.003219532, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:02.12771+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:02.13317+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:02.0573+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=48.99 2023-07-21T22:33:02.13426+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.58 2023-07-21T22:33:02.13497+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=21.56 2023-07-21T22:33:02.13575+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:02.13563+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.078983931, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:02.05656+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:02.14424+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:02.14514+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:02.15122+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:02.15185+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:02.15284+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:02.15328+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:02.15404+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:02.22579+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:02.22853+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:02.22964+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.527198126, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:02.17392+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:02.22759+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:02.23368+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:02.25558+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:02.28184+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:02.2904+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:02.29317+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:02.29657+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:02.35207+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:02.35169+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=7.721169514, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:02.35388+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:02.36209+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:02.13378+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:02.23341+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:02.46977+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:32:56.6955+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:33:02.47813+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:02.47973+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:33:02.48173+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:33:02.48183+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:02.47996+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:02.24858+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:02.48694+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:33:02.48899+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:02.48901+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:02.50697+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:02.47516+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:33:02.50207+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:02.50674+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:02.50765+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000767563, err="couldn't get SNTP reply: read udp 127.0.0.1:24447->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:02.50235+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:33:02.67884+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:02.61555+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:02.71373+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:33:02.72646+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T22:33:02.71958+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:02.7843+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:03.01351+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:03.01381+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.076053713, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:03.07633+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T22:33:03.05233+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:33:03.08644+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:33:03.08852+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:33:03.08924+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:33:03.08614+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T22:33:03.08562+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:03.10141+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T22:33:03.10171+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:03.10172+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:03.10565+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:03.1065+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:03.10081+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=15.559086103, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:03.10354+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.160924718, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:03.1074+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:33:03.13265+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:33:03.1333+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:33:03.14066+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:03.16262+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:33:03.31317+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:33:03.31384+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:33:03.31423+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:33:03.31467+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/blkio 2023-07-21T22:33:03.31519+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/perf_event 2023-07-21T22:33:03.31568+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:33:03.31622+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:33:03.31673+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:33:03.31742+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:33:03.61083+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/net_cls,net_prio" 2023-07-21T22:33:03.27096+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:03.61544+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:03.61277+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:33:03.69196+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:03.69274+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:03.6128+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:03.8001+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint="/sys/fs/cgroup/cpu,cpuacct" 2023-07-21T22:33:03.8069+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/cpuset 2023-07-21T22:33:03.80736+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/memory 2023-07-21T22:33:03.80778+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/freezer 2023-07-21T22:33:03.80815+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:33:03.10217+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T22:33:03.67209+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/devices 2023-07-21T22:33:03.91389+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.601396796, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:03.84627+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.692782833999999, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:03.80053+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:03.70858+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:03.93383+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:33:03.93545+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:33:03.94119+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T22:33:03.81418+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:03.83387+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=48.99 2023-07-21T22:33:03.96535+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.58 2023-07-21T22:33:04.0715+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/hugetlb 2023-07-21T22:33:03.97081+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=21.56 2023-07-21T22:33:04.07149+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T22:33:04.44791+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.74570072, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:04.07266+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:33:04.44951+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T22:33:04.44941+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.023505282, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:04.45035+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T22:33:04.45098+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T22:33:04.45136+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T22:33:04.09488+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:04.5142+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T22:33:04.51494+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T22:33:04.51594+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T22:33:04.45227+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T22:33:04.24864+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=48.99 2023-07-21T22:33:03.10251+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:04.62561+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.58 2023-07-21T22:33:04.90192+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:04.9027+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:04.90665+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=48.99 2023-07-21T22:33:04.90776+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.58 2023-07-21T22:33:04.91236+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.21293705, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:04.56796+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:04.42759+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:04.0739+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1320281088e+10 Active_bytes:3.2798601216e+10 Active_file_bytes:1.478320128e+09 AnonHugePages_bytes:2.973761536e+10 AnonPages_bytes:3.1322914816e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.03433984e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6742680576e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:425984 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57641728e+08 Inactive_file_bytes:5.40336128e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.32001792e+08 MemAvailable_bytes:1.3161324544e+10 MemFree_bytes:1.5428927488e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.6517376e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18509568e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10522112e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:04.90358+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu21, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:04.51727+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1319478272e+10 Active_bytes:3.2797782016e+10 Active_file_bytes:1.478303744e+09 AnonHugePages_bytes:2.9733421056e+10 AnonPages_bytes:3.1317516288e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034323456e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6741632e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:409600 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57645824e+08 Inactive_file_bytes:5.40340224e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.319936e+08 MemAvailable_bytes:1.3165584384e+10 MemFree_bytes:1.5433191424e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.624704e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18509568e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10522112e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:04.72479+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.03413485, err="couldn't get SNTP reply: read udp 127.0.0.1:42899->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:04.62619+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:04.95713+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=21.56 2023-07-21T22:33:04.98467+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=48.99 2023-07-21T22:33:04.68659+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.5966156649999999, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:04.9835+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:04.96342+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.137573773, err="couldn't get SNTP reply: read udp 127.0.0.1:56667->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:05.11616+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:05.10358+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:05.1038+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.288031911, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:05.11686+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.205331757, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:05.15588+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.58 2023-07-21T22:33:05.15705+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.651893312, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:05.17272+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:05.19132+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=21.56 2023-07-21T22:33:05.19643+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.5935347439999998, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:05.19831+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.183445564, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:05.21422+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu21, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:05.21947+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:05.22042+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:05.21983+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=48.99 2023-07-21T22:33:05.22021+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000735107, err="couldn't get SNTP reply: read udp 127.0.0.1:58070->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:05.22275+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.781542511, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T22:33:05.22888+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:05.22972+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.888590811, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:05.22976+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002126254, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:05.21907+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:05.21449+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:05.2321+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:05.23581+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:32:57.34175+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:32:57.50972+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/pids 2023-07-21T22:33:05.23527+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:05.23238+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:05.22347+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1319580672e+10 Active_bytes:3.2797888512e+10 Active_file_bytes:1.47830784e+09 AnonHugePages_bytes:2.9733421056e+10 AnonPages_bytes:3.131746304e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034323456e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6741632e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:409600 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57641728e+08 Inactive_file_bytes:5.40336128e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.319936e+08 MemAvailable_bytes:1.316542464e+10 MemFree_bytes:1.543303168e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.6259328e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18509568e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10522112e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:05.23671+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=13.645911836, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T22:33:05.24816+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:05.25643+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.036891907, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:05.25547+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.048207442, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:05.25662+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=21.56 2023-07-21T22:33:05.26099+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:05.26877+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:05.24645+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1366803456e+10 Active_bytes:3.2845144064e+10 Active_file_bytes:1.478340608e+09 AnonHugePages_bytes:2.9741809664e+10 AnonPages_bytes:3.1364595712e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034356224e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6759261184e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:442368 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57637632e+08 Inactive_file_bytes:5.40332032e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.32005888e+08 MemAvailable_bytes:1.3119758336e+10 MemFree_bytes:1.5387353088e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.673856e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18509568e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10522112e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:05.27332+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:05.26121+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:05.27896+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:05.36239+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:05.70331+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:05.83959+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.89078918, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:05.8241+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:05.37157+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:05.84619+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu22, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:05.84468+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:06.02578+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:06.02016+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:06.02638+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:06.0267+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:06.07821+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:06.15832+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.58 2023-07-21T22:33:06.18153+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:06.20116+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:06.20193+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:06.20213+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:06.20232+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/config 2023-07-21T22:33:06.20189+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:06.20418+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:06.20887+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.950568215, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:06.23899+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:06.24588+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.5999618070000001, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:06.20369+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:06.2477+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:06.23857+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:06.24587+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:06.3048+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.077419894, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:06.30604+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00063952, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:06.30484+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.034955824, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:06.30622+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:06.30459+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:06.31375+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu22, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:06.30664+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:06.31409+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:06.30454+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.055621645, err="couldn't get SNTP reply: read udp 127.0.0.1:44049->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:06.522+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:06.58357+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:06.68226+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:06.68326+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.434839073, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:06.97416+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:06.69328+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:06.50231+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:07.09845+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=21.56 2023-07-21T22:33:07.01302+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:06.51196+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.76 2023-07-21T22:33:06.97342+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.040778111, err="couldn't get SNTP reply: read udp 127.0.0.1:22344->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:07.09768+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:07.10417+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.132782348, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:07.01344+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000540788, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:07.09781+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:33:07.22629+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:07.09982+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:06.67398+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1390199808e+10 Active_bytes:3.2868569088e+10 Active_file_bytes:1.47836928e+09 AnonHugePages_bytes:2.9746003968e+10 AnonPages_bytes:3.1391260672e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034384896e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6772007936e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:471040 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57637632e+08 Inactive_file_bytes:5.40332032e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.3201408e+08 MemAvailable_bytes:1.3096271872e+10 MemFree_bytes:1.536385024e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.7242368e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18525952e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10538496e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:07.09799+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.76 2023-07-21T22:33:07.70446+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:07.5955+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc/sys/fs/binfmt_misc 2023-07-21T22:33:07.7098+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:07.52586+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:07.71242+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:07.65885+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:07.7137+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.185096805, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:07.71278+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:07.71328+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:08.33719+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.002851777, err="couldn't get SNTP reply: read udp 127.0.0.1:32759->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:07.71288+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:08.47985+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000685053, err="couldn't get SNTP reply: read udp 127.0.0.1:57853->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:07.71305+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:08.48736+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:08.74783+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.76 2023-07-21T22:33:08.55501+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:08.55526+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.680860913, err="couldn't get SNTP reply: read udp 127.0.0.1:59776->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:08.55546+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.954246534, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:08.55434+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1416741888e+10 Active_bytes:3.2895135744e+10 Active_file_bytes:1.478393856e+09 AnonHugePages_bytes:2.9746003968e+10 AnonPages_bytes:3.141679104e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034413568e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6784381952e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:512000 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57641728e+08 Inactive_file_bytes:5.40336128e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.3201408e+08 MemAvailable_bytes:1.3070221312e+10 MemFree_bytes:1.5337787392e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.7651968e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18534144e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10546688e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:08.75573+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:08.75832+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:08.76251+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:08.75521+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:08.76279+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:08.54206+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:08.76297+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:08.77649+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:08.77609+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:08.77856+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:08.77867+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:08.78949+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:08.79152+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:08.79254+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:08.78806+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.96921195, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:08.54158+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:08.77124+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:08.93652+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.141562368e+10 Active_bytes:3.2894017536e+10 Active_file_bytes:1.478393856e+09 AnonHugePages_bytes:2.9746003968e+10 AnonPages_bytes:3.1416233984e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034413568e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6782809088e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:512000 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57641728e+08 Inactive_file_bytes:5.40336128e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.3201408e+08 MemAvailable_bytes:1.3071077376e+10 MemFree_bytes:1.5338643456e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.7651968e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18534144e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10546688e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:08.76286+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:08.98389+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.221838816, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:09.20417+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:09.21554+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:09.22242+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:09.26749+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.010087333, err="couldn't get SNTP reply: read udp 127.0.0.1:55459->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:09.22271+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu23, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:58.70427+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:09.40885+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:32:58.70592+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu23, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:09.41014+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:09.41057+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:09.39284+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:58.78936+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:09.41864+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:09.41624+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=0, fields.level=debug, fields.msg="CPU Idle counter jumped backwards", new_value=89964.1, old_value=89964.27 2023-07-21T22:33:09.43352+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:09.41923+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.043315734, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:09.48953+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:09.41922+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:32:58.71869+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:32:58.78877+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:09.52479+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:09.50189+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:58.86731+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:09.59039+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.3140071429999995, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:09.59166+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=30.11 2023-07-21T22:32:58.82927+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:09.6875+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:09.69384+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:14.4888+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:33:09.8981+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:32:58.94958+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=52.13 2023-07-21T22:32:58.87065+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:09.69408+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:09.89791+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:33:09.90063+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=30.11 2023-07-21T22:33:09.8999+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:32:59.21615+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:10.74437+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:59.30606+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T22:33:10.90722+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:10.94486+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:10.96356+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:10.95888+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.431765287, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:10.95374+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:11.00218+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:10.90658+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.14752e+10 Active_bytes:3.2953638912e+10 Active_file_bytes:1.478438912e+09 AnonHugePages_bytes:2.976907264e+10 AnonPages_bytes:3.1475449856e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.03446272e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6828585984e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:565248 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57641728e+08 Inactive_file_bytes:5.40336128e+08 KernelStack_bytes:2.3642112e+07 Mapped_bytes:1.32030464e+08 MemAvailable_bytes:1.3007187968e+10 MemFree_bytes:1.5274729472e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.8364672e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18616064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10628608e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:14.37791+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000609366, err="couldn't get SNTP reply: read udp 127.0.0.1:29199->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:10.95767+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.146328064e+10 Active_bytes:3.2941699072e+10 Active_file_bytes:1.478418432e+09 AnonHugePages_bytes:2.9752295424e+10 AnonPages_bytes:3.145670656e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034438144e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6817051648e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:540672 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57641728e+08 Inactive_file_bytes:5.40336128e+08 KernelStack_bytes:2.3642112e+07 Mapped_bytes:1.32026368e+08 MemAvailable_bytes:1.3022240768e+10 MemFree_bytes:1.528979456e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.8155776e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18546432e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10558976e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:32:58.88169+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.16881833, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:11.00987+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:32:58.92288+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:32:58.9487+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:10.59117+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.256282235, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:11.0108+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:12.89986+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:12.65838+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:12.90345+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:13.66495+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:14.03424+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:14.03429+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:14.32786+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:14.32998+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.572972254, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:14.33036+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:14.33198+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1477571584e+10 Active_bytes:3.2956030976e+10 Active_file_bytes:1.478459392e+09 AnonHugePages_bytes:2.9752295424e+10 AnonPages_bytes:3.1477612544e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034479104e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6823867392e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:581632 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57645824e+08 Inactive_file_bytes:5.40340224e+08 KernelStack_bytes:2.3642112e+07 Mapped_bytes:1.32030464e+08 MemAvailable_bytes:1.3006716928e+10 MemFree_bytes:1.5274246144e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.856128e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.1864064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10653184e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:14.33142+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:14.33249+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.375016098, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:14.36192+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu23, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:14.37701+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.250536489, err="couldn't get SNTP reply: read udp 127.0.0.1:29822->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:14.49836+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:14.49794+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:14.51533+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:14.51545+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:14.49981+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:14.50045+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.263423833, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:14.51662+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:14.53329+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:14.66614+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:33:14.5338+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:14.77289+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:33:14.52599+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:14.77521+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:14.77883+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.250941283, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:14.82113+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:14.8417+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.336353351, err="couldn't get SNTP reply: read udp 127.0.0.1:18373->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:14.84279+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:14.32955+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:14.842+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.8870961130000001, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:14.83258+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.397395901, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:14.82575+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.62 2023-07-21T22:32:59.38074+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.160886224, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:14.85017+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:14.85127+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:00.58484+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:14.84299+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:33:14.85047+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:14.83236+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:01.94258+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:14.89544+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000723201, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:14.9605+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:14.96079+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, sum(total_waits) as total_waits, sum(time_waited_micro) / 1000000 as time_waited from v$system_event join __all_tenant on v$system_event.con_id = __all_tenant.tenant_id where v$system_event.wait_class <> 'IDLE' group by tenant_name 2023-07-21T22:33:15.03444+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.62 2023-07-21T22:33:15.19665+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T22:33:15.21238+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:15.2158+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.25638798, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:15.21431+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T22:33:02.01516+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:15.57876+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.751481897, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:15.21782+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:15.22267+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:17.20431+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:17.28972+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:16.32374+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1477354496e+10 Active_bytes:3.295582208e+10 Active_file_bytes:1.478467584e+09 AnonHugePages_bytes:2.9752295424e+10 AnonPages_bytes:3.1480705024e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034495488e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.682701312e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:573440 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57645824e+08 Inactive_file_bytes:5.40340224e+08 KernelStack_bytes:2.3642112e+07 Mapped_bytes:1.3203456e+08 MemAvailable_bytes:1.300211712e+10 MemFree_bytes:1.526964224e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.8974976e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.1866112e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10673664e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:17.34222+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:17.44139+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:14.37966+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.351800027, err="couldn't get SNTP reply: write udp 127.0.0.1:15262->127.0.0.1:123: i/o timeout", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:05.10429+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:04.98331+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:18.16607+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=28.84 2023-07-21T22:33:05.0766+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:18.16715+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:06.31427+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.76 2023-07-21T22:33:06.37951+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.065904907, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:18.16845+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:18.16854+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:18.1703+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:18.17283+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:18.17342+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:18.17497+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:06.46905+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:18.19799+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:33:18.19847+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:18.1983+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:18.43987+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:33:18.44943+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:18.4523+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:00.6837+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:18.48135+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.09 2023-07-21T22:33:18.49461+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:18.48274+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=18.82928782, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:18.67097+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.1 2023-07-21T22:33:18.68299+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=18.983703915, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:18.47825+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:18.6939+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=19.141446193, err="couldn't get SNTP reply: read udp 127.0.0.1:53388->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:18.82599+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:18.48299+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1230091264e+10 Active_bytes:3.2708296704e+10 Active_file_bytes:1.47820544e+09 AnonHugePages_bytes:2.9729226752e+10 AnonPages_bytes:3.1228096512e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034245632e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6704595968e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:430080 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.5762944e+08 Inactive_file_bytes:5.4032384e+08 KernelStack_bytes:2.3642112e+07 Mapped_bytes:1.31915776e+08 MemAvailable_bytes:1.3260988416e+10 MemFree_bytes:1.55286528e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5026432e+07 SReclaimable_bytes:9.2008448e+07 SUnreclaim_bytes:1.18431744e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10440192e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:18.82624+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.09 2023-07-21T22:33:18.82666+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:18.88669+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=19.216017488, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:18.88739+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:18.88765+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:18.95878+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1231582208e+10 Active_bytes:3.2709787648e+10 Active_file_bytes:1.47820544e+09 AnonHugePages_bytes:2.9729226752e+10 AnonPages_bytes:3.1229210624e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034245632e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6705644544e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:430080 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.5762944e+08 Inactive_file_bytes:5.4032384e+08 KernelStack_bytes:2.3642112e+07 Mapped_bytes:1.31915776e+08 MemAvailable_bytes:1.3259771904e+10 MemFree_bytes:1.5527436288e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.5026432e+07 SReclaimable_bytes:9.2008448e+07 SUnreclaim_bytes:1.18431744e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10440192e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:18.92644+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:19.04724+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=19.325516411, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:19.04943+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.5103001, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:19.23135+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:19.88976+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.823302239, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:19.89077+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:19.23095+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=20.2438097, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:20.06079+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.599847784, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:20.06415+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.09 2023-07-21T22:33:20.0542+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1519399936e+10 Active_bytes:3.299796992e+10 Active_file_bytes:1.478569984e+09 AnonHugePages_bytes:2.9752295424e+10 AnonPages_bytes:3.15194368e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034593792e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6846149632e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:299008 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57641728e+08 Inactive_file_bytes:5.40336128e+08 KernelStack_bytes:2.3625728e+07 Mapped_bytes:1.32104192e+08 MemAvailable_bytes:1.2964696064e+10 MemFree_bytes:1.5232172032e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9855616e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18673408e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10685952e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:20.15784+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000757288, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:20.0859+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=20.467879778, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:20.072+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1519399936e+10 Active_bytes:3.299796992e+10 Active_file_bytes:1.478569984e+09 AnonHugePages_bytes:2.9752295424e+10 AnonPages_bytes:3.1519432704e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034593792e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6846149632e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:299008 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57641728e+08 Inactive_file_bytes:5.40336128e+08 KernelStack_bytes:2.3625728e+07 Mapped_bytes:1.32104192e+08 MemAvailable_bytes:1.296398336e+10 MemFree_bytes:1.5231459328e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9855616e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18673408e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10685952e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:20.30351+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:20.31424+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:20.32445+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:20.41382+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.09 2023-07-21T22:33:20.30688+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000820174, err="couldn't get SNTP reply: read udp 127.0.0.1:54574->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:20.99724+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:20.98968+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:21.00581+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:21.14658+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:21.16827+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:21.25342+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:21.54068+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:20.80015+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:21.62624+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:21.7234+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.878794798, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:21.72351+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:21.65681+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.007132334, err="couldn't get SNTP reply: read udp 127.0.0.1:8636->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:21.93193+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:22.00304+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:22.01179+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.084141286, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:22.18589+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.641072385, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:22.02541+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:22.66199+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:22.26685+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:22.65789+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:22.6078+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:22.10744+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:22.17653+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1575195648e+10 Active_bytes:3.3053806592e+10 Active_file_bytes:1.478610944e+09 AnonHugePages_bytes:2.9756489728e+10 AnonPages_bytes:3.1557513216e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034642944e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6895858688e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:352256 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57658112e+08 Inactive_file_bytes:5.40352512e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.32378624e+08 MemAvailable_bytes:1.2905320448e+10 MemFree_bytes:1.5172755456e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0367616e+07 SReclaimable_bytes:9.2033024e+07 SUnreclaim_bytes:1.18738944e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10771968e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:06.77922+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:22.1556+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:22.77653+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:22.81469+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:22.77268+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=12.225376913, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:22.80561+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:22.82904+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:22.87079+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:22.84035+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:22.95775+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:22.84004+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:22.97008+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:22.98118+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:22.95754+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:23.19765+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:23.35509+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:24.43575+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:24.25754+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:24.57375+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:27.40324+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=56.54 2023-07-21T22:33:27.48627+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:27.48623+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:33:27.4875+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001246797, err="couldn't get SNTP reply: read udp 127.0.0.1:34979->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:28.29071+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:28.65238+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.351205996, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:29.05887+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu3, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:28.29918+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1565070336e+10 Active_bytes:3.304380416e+10 Active_file_bytes:1.478733824e+09 AnonHugePages_bytes:2.974810112e+10 AnonPages_bytes:3.1565828096e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034765824e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.687698432e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:303104 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57658112e+08 Inactive_file_bytes:5.40352512e+08 KernelStack_bytes:2.3691264e+07 Mapped_bytes:1.32411392e+08 MemAvailable_bytes:1.2913577984e+10 MemFree_bytes:1.5180951552e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.06912e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18788096e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10825216e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:28.83855+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.328133302, err="couldn't get SNTP reply: read udp 127.0.0.1:47259->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:28.84235+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.111055007, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:29.0355+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=56.54 2023-07-21T22:33:29.06042+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.363029544, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:29.15494+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:29.30801+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.520166012, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:29.35273+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:29.38006+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:29.44815+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:29.11951+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:29.47785+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:29.5373+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:29.53456+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=8.224053358, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:29.72424+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:29.72634+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=24.538232829000002, err="couldn't get SNTP reply: read udp 127.0.0.1:32474->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:29.72461+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:29.72405+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:29.72389+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:29.72935+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:29.72475+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:29.7349+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:29.73806+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=24.540374201, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:29.7367+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=26.479169994, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:29.7391+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:29.74439+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:29.74697+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:29.79679+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=21.001365775, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:30.11236+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=26.741570274, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:30.12365+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:30.12538+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1351402496e+10 Active_bytes:3.2829743104e+10 Active_file_bytes:1.478340608e+09 AnonHugePages_bytes:2.9741809664e+10 AnonPages_bytes:3.13495552e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034356224e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6751757312e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:442368 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57637632e+08 Inactive_file_bytes:5.40332032e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.32005888e+08 MemAvailable_bytes:1.3135896576e+10 MemFree_bytes:1.5401394176e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.673856e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18509568e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10522112e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:30.25381+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:09.96097+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.654506151, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:32:58.99704+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:33:30.30124+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=25.09603827, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:30.25894+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:30.41383+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:30.46649+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.9778035210000002, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:30.47054+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:30.54451+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:34.87864+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.192040652, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:30.54701+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=23.025304865, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:34.91559+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:30.56969+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:38.27917+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=51.27 2023-07-21T22:33:39.55139+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=31.72 2023-07-21T22:33:34.92297+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T22:33:34.88248+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:33:38.27201+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=51.27 2023-07-21T22:33:39.55154+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:30.7639+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:38.27108+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.790134006, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:30.76379+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:34.90654+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:33:39.83652+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:10.01084+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/debug 2023-07-21T22:33:39.70163+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:34.9294+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.88124606, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:39.65733+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.89 2023-07-21T22:33:30.7288+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.680614301, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T22:33:30.77618+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:33.90337+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name, active, total, freeze_trigger, freeze_cnt from gv$memstore, __all_tenant where gv$memstore.tenant_id = __all_tenant.tenant_id and ip = ? and port = ? 2023-07-21T22:33:33.91982+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T22:33:33.88265+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:33:34.8362+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:34.87323+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=25.46893618, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:34.87167+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:33:34.87074+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:33:34.87326+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T22:33:34.87367+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.928239176, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:34.8734+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, __all_unit_config.name, max_cpu, min_cpu, max_memory, min_memory, max_iops, min_iops, max_disk_size, max_session_num from __all_tenant, __all_resource_pool, __all_unit_config, __all_unit where __all_tenant.tenant_id = __all_resource_pool.tenant_id and __all_resource_pool.unit_config_id = __all_unit_config.unit_config_id and __all_unit.resource_pool_id = __all_resource_pool.resource_pool_id and __all_unit.svr_ip = ? and __all_unit.svr_port = ? 2023-07-21T22:33:11.6313+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:34.87566+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:34.88062+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu10, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:39.50668+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.121249709, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:11.62824+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:39.65577+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:39.66771+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:11.63059+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=12.179607857, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:35.14286+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=20.292793883, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:39.65592+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.103691157, err="couldn't get SNTP reply: read udp 127.0.0.1:39811->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:34.95535+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:34.95567+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:10.16017+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.76 2023-07-21T22:33:39.84019+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00059264, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:10.16589+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:34.95616+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.012739646, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:34.96348+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:33:10.27477+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.136760748, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:10.27806+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:34.96606+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.25 2023-07-21T22:33:35.00787+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T22:33:35.35254+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:35.35526+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1703801856e+10 Active_bytes:3.3182629888e+10 Active_file_bytes:1.478828032e+09 AnonHugePages_bytes:2.9764878336e+10 AnonPages_bytes:3.170158592e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034868224e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6939968512e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:266240 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57662208e+08 Inactive_file_bytes:5.40356608e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.3242368e+08 MemAvailable_bytes:1.277212672e+10 MemFree_bytes:1.5039451136e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.169472e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18898688e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10935808e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:37.24993+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:37.32122+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:37.30903+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=0, fields.level=debug, fields.msg="CPU User counter jumped backwards", new_value=7111.07, old_value=7111.09 2023-07-21T22:33:37.38938+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:33:37.32162+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:37.30204+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:33:37.38875+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:37.61135+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:37.62181+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.044129526, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:37.59796+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:37.60132+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:33:37.56899+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:10.47874+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:37.95758+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ case when cnt is null then 0 else cnt end as cnt, tenant_name from (select __all_tenant.tenant_name, cnt from __all_tenant left join (select count(*) as cnt, tenant as tenant_name from __all_virtual_processlist where svr_ip = ? and svr_port = ? group by tenant) t1 on __all_tenant.tenant_name = t1.tenant_name) t2 2023-07-21T22:33:37.62624+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.300497891, err="couldn't get SNTP reply: read udp 127.0.0.1:38608->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:37.82461+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=51.27 2023-07-21T22:33:37.9581+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.126627497, err="couldn't get SNTP reply: read udp 127.0.0.1:15997->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:37.83044+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=23.055068055, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:10.4846+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1414505472e+10 Active_bytes:3.2892899328e+10 Active_file_bytes:1.478393856e+09 AnonHugePages_bytes:2.9746003968e+10 AnonPages_bytes:3.1415119872e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034413568e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6782809088e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:512000 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57641728e+08 Inactive_file_bytes:5.40336128e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.3201408e+08 MemAvailable_bytes:1.3072359424e+10 MemFree_bytes:1.5339925504e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.7651968e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18534144e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10546688e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:10.27781+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:10.33707+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:10.1765+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:10.50482+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:10.50573+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=30.11 2023-07-21T22:33:10.52985+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:10.52988+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.251764581, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:10.52459+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.375873414, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:10.55+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:10.54946+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:10.59034+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:38.03478+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.151534544, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:38.04198+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1734775808e+10 Active_bytes:3.3213640704e+10 Active_file_bytes:1.478864896e+09 AnonHugePages_bytes:2.976907264e+10 AnonPages_bytes:3.1735963648e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.03491328e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6961169408e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:311296 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57666304e+08 Inactive_file_bytes:5.40360704e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32427776e+08 MemAvailable_bytes:1.274198016e+10 MemFree_bytes:1.5009284096e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2014208e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18919168e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10956288e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:37.95821+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:38.16522+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.673806098, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:37.95794+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:33:38.06288+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:38.19972+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:38.20265+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:33:38.20977+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:39.34848+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:32:59.30567+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:38.20274+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:38.20253+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.174651904e+10 Active_bytes:3.322540032e+10 Active_file_bytes:1.47888128e+09 AnonHugePages_bytes:2.976907264e+10 AnonPages_bytes:3.1747936256e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034925568e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.696850944e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:339968 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57662208e+08 Inactive_file_bytes:5.40356608e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32427776e+08 MemAvailable_bytes:1.2728909824e+10 MemFree_bytes:1.4996209664e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2194432e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.1892736e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.1096448e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:38.30642+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:38.30907+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.012744806, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:38.32156+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:38.32323+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:38.3249+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:11.73604+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.331035057, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:11.73778+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:38.3296+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.038958633, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:38.3293+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:38.33058+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:38.33+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.059285348, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:38.33003+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.004819249, err="couldn't get SNTP reply: read udp 127.0.0.1:33522->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:38.33263+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:38.53005+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.241187037, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:38.84824+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:39.10691+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:11.70271+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=12.753038329, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:12.72574+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00068871, err="couldn't get SNTP reply: read udp 127.0.0.1:55560->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:38.29315+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:39.662+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=31.72 2023-07-21T22:33:38.27191+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.014796379, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:39.84107+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:38.29775+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:39.84168+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.183658171, err="couldn't get SNTP reply: read udp 127.0.0.1:34465->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:39.84229+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1799308288e+10 Active_bytes:3.3278210048e+10 Active_file_bytes:1.47890176e+09 AnonHugePages_bytes:2.9781655552e+10 AnonPages_bytes:3.1799570432e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034966528e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6997148672e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:380928 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57666304e+08 Inactive_file_bytes:5.40360704e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32431872e+08 MemAvailable_bytes:1.2677541888e+10 MemFree_bytes:1.494482944e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2722816e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18960128e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10997248e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:39.86036+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:39.84063+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=51.27 2023-07-21T22:33:39.84118+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00133568, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:39.86298+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:39.88278+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.390701228, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:39.8823+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.6073928880000001, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:39.88164+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:39.90478+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:39.90971+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/mqueue 2023-07-21T22:33:39.91333+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=51.27 2023-07-21T22:33:39.90585+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:39.91548+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:39.91576+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000790858, err="couldn't get SNTP reply: read udp 127.0.0.1:9218->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:46.01836+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.58609878, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:39.91859+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00239369, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:44.68471+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.099468396, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:42.19907+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:44.72847+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:46.04078+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:46.0424+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:46.04303+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:46.04433+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:46.04505+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu13, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:46.04597+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:44.80268+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.185383424e+10 Active_bytes:3.333279744e+10 Active_file_bytes:1.4789632e+09 AnonHugePages_bytes:2.9783752704e+10 AnonPages_bytes:3.1854170112e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.035027968e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7021851648e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:442368 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57686784e+08 Inactive_file_bytes:5.40381184e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32448256e+08 MemAvailable_bytes:1.2618862592e+10 MemFree_bytes:1.4886109184e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.3369984e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.19128064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11165184e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:46.04751+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:45.63574+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:46.04102+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:46.05069+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:46.05156+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:33:46.04667+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu14, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:46.04886+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:44.80321+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:46.05558+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:46.05664+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:46.05762+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:46.03964+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:44.67373+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=49.73 2023-07-21T22:33:44.83931+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=31.96 2023-07-21T22:33:44.9252+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.79695007, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:44.85654+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.032578016, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:46.05824+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu16, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:46.06632+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:46.05215+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:33:46.06652+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:46.08403+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu17, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:46.06366+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=31.72 2023-07-21T22:33:46.09276+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.94 2023-07-21T22:33:46.09307+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.943087558, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:46.09179+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:46.09375+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.510487129, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:46.09429+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu18, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:45.15417+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:45.1724+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.4623907, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:45.2718+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:46.08262+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:33:45.12721+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:46.09922+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:45.27226+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=49.73 2023-07-21T22:33:46.09714+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:46.10148+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=31.72 2023-07-21T22:33:46.06473+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.92 2023-07-21T22:33:46.12331+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.94 2023-07-21T22:33:46.12842+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=11.186566154, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:46.1273+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:33:46.12976+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:33:46.13033+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:33:46.12855+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.936857218, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:45.34659+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.12010736, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:46.10071+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:33:40.08296+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:43.07997+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:43.34733+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:42.90698+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:43.08701+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:42.79328+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:40.28473+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:43.44717+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1513034752e+10 Active_bytes:3.2991563776e+10 Active_file_bytes:1.478529024e+09 AnonHugePages_bytes:2.9752295424e+10 AnonPages_bytes:3.1515308032e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034556928e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6843528192e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:634880 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57645824e+08 Inactive_file_bytes:5.40340224e+08 KernelStack_bytes:2.3625728e+07 Mapped_bytes:1.32083712e+08 MemAvailable_bytes:1.296726016e+10 MemFree_bytes:1.5234756608e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.9642624e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18673408e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10685952e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:43.71266+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:40.28421+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:43.75089+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:43.0798+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:43.09494+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:43.4471+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.538265165, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:43.70604+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:43.8103+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:43.81179+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=49.73 2023-07-21T22:33:43.81187+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:43.71681+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=31.121909354, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:43.93585+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.701009147, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:44.01322+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:44.08477+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:44.1248+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:44.19141+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:44.34975+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:44.44305+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:44.48077+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:44.38273+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:44.38343+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:44.48002+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:44.56792+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=26.995948722, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:44.19839+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:44.59471+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:44.57298+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:44.49835+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.185569792e+10 Active_bytes:3.333466112e+10 Active_file_bytes:1.4789632e+09 AnonHugePages_bytes:2.9783752704e+10 AnonPages_bytes:3.1856398336e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.035027968e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7022375936e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:442368 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57686784e+08 Inactive_file_bytes:5.40381184e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32448256e+08 MemAvailable_bytes:1.2617719808e+10 MemFree_bytes:1.48849664e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.3369984e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.19128064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11165184e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:44.20932+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.124472524, err="couldn't get SNTP reply: read udp 127.0.0.1:6732->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:44.59477+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=30.11 2023-07-21T22:33:44.62271+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.025505623, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:44.78655+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:39.92055+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:44.62301+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:46.10043+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:45.49376+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:45.49578+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:45.49419+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=31.72 2023-07-21T22:33:45.5033+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.048552429, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:40.10965+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:45.61157+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:40.10008+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.179573311, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:45.61199+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:46.01574+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:44.81077+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:41.78822+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:44.78624+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:45.35824+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.075583792, err="couldn't get SNTP reply: read udp 127.0.0.1:10593->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:45.32708+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.280631976, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:45.81462+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:45.14995+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.281518052, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:45.4708+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:45.81731+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:45.839+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.89 2023-07-21T22:33:45.88372+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:45.8837+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=31.72 2023-07-21T22:33:45.88316+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:45.88535+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:45.92307+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:45.92352+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/hugepages 2023-07-21T22:33:45.92972+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:46.01368+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:45.92996+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:45.95324+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:45.92289+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=31.72 2023-07-21T22:33:45.92434+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:46.10135+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu19, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:46.1452+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:33:46.20269+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:46.05587+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:33:46.15283+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:46.20648+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:46.2043+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=31.72 2023-07-21T22:33:46.16744+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=29.014496314, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:46.21232+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:46.20746+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:46.21586+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:46.22999+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:46.21558+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:46.20786+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:33:46.21369+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:46.20689+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:46.28836+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.1 2023-07-21T22:33:46.28982+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.075567148, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:46.44156+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:46.44875+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:46.44059+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1907889152e+10 Active_bytes:3.3386876928e+10 Active_file_bytes:1.478987776e+09 AnonHugePages_bytes:2.9783752704e+10 AnonPages_bytes:3.1902748672e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.035052544e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7065531392e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:466944 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57686784e+08 Inactive_file_bytes:5.40381184e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32452352e+08 MemAvailable_bytes:1.2558741504e+10 MemFree_bytes:1.4825975808e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.3812352e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.19156736e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11193856e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:46.47918+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:46.47523+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000692881, err="couldn't get SNTP reply: read udp 127.0.0.1:14007->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:46.47362+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:46.47247+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.030449536, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:46.47343+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001241656, err="couldn't get SNTP reply: read udp 127.0.0.1:5007->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:46.48001+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:46.47691+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=56.8 2023-07-21T22:33:46.26652+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.053999923, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:46.48024+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:46.47707+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.190679552e+10 Active_bytes:3.3385836544e+10 Active_file_bytes:1.479041024e+09 AnonHugePages_bytes:2.9785849856e+10 AnonPages_bytes:3.19067136e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.035109888e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7054521344e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:524288 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.5769088e+08 Inactive_file_bytes:5.4038528e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32456448e+08 MemAvailable_bytes:1.2564881408e+10 MemFree_bytes:1.483208704e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.402944e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.19169024e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11206144e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:46.48025+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.00634946, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:46.48285+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.89 2023-07-21T22:33:46.48243+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:46.48093+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000422448, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:46.48432+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.008645827, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:46.47366+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=56.8 2023-07-21T22:33:18.1555+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.584048574, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:17.82469+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:18.15575+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:46.49625+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:33:20.93797+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.491717571, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:46.49959+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:24.6154+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:25.04898+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.624356986, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:25.6354+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:25.70356+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:21.14039+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=52.32 2023-07-21T22:33:25.94704+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:46.49625+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:25.95079+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:25.97456+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:25.97778+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=24.905394713, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:25.97801+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.136990821, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:26.41218+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:46.53009+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:26.58667+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:26.137+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:26.36934+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:46.53172+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:21.14121+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:27.05446+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:26.9189+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:21.17655+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T22:33:21.19971+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:27.05421+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:27.0555+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.85306499, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:21.25366+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:21.254+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:21.25536+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000869205, err="couldn't get SNTP reply: read udp 127.0.0.1:21848->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:21.25345+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:21.51616+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:46.55309+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.89 2023-07-21T22:33:46.55104+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:46.55287+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=8.31084267, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:21.5321+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.046471323, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:21.46297+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:21.47152+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:21.53863+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:21.54015+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:21.25555+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1535771648e+10 Active_bytes:3.3014349824e+10 Active_file_bytes:1.478578176e+09 AnonHugePages_bytes:2.9752295424e+10 AnonPages_bytes:3.1534723072e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034610176e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.685978112e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:315392 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.5764992e+08 Inactive_file_bytes:5.4034432e+08 KernelStack_bytes:2.3642112e+07 Mapped_bytes:1.32104192e+08 MemAvailable_bytes:1.2945809408e+10 MemFree_bytes:1.5213268992e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.993344e+07 SReclaimable_bytes:9.2028928e+07 SUnreclaim_bytes:1.186816e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10710528e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:47.39447+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:32.41294+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:32.0732+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:47.42127+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:33:32.1599+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.367375616, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:32.41342+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:47.64869+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:47.3535+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=19.05673219, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:47.64276+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=48.23799325, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:32.23026+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:47.82041+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:47.64272+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.94 2023-07-21T22:33:47.35691+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:47.69375+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:47.75071+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:47.62459+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:47.63784+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.54429881, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:32.22248+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000823952, err="couldn't get SNTP reply: read udp 127.0.0.1:57171->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:47.43115+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:47.87601+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=48.554850917, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:47.91797+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:47.45368+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:47.61545+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:47.4534+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:47.74232+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=45.273592049, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:47.92339+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:48.09414+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:47.87477+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:47.89609+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:32.41278+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:48.00488+08:00 INFO [14040,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server 2023-07-21T22:33:48.06368+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:48.09027+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=47.832370907, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:48.20648+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:48.21087+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:48.00737+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=20.613122757, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:48.22937+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:48.22947+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:50.39458+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=56.8 2023-07-21T22:33:50.47335+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:51.67062+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:51.88039+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:51.82571+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:50.30661+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1968718848e+10 Active_bytes:3.3447817216e+10 Active_file_bytes:1.479098368e+09 AnonHugePages_bytes:2.9787947008e+10 AnonPages_bytes:3.1969652736e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.035175424e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7095776256e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:589824 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57694976e+08 Inactive_file_bytes:5.40389376e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32456448e+08 MemAvailable_bytes:1.250179072e+10 MemFree_bytes:1.4768963584e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.4824064e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.1925504e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.1129216e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:50.55744+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.3062987, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:51.86866+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:51.92275+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:51.63908+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.1663483430000001, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:51.91716+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.9410625449999999, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:51.93028+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:52.18567+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:51.95118+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.640561382, err="couldn't get SNTP reply: read udp 127.0.0.1:27820->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:51.92989+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:52.83968+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:52.67922+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:52.18585+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:52.1911+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=42.05280893, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:52.96247+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T22:33:52.57345+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:52.50263+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=33.49 2023-07-21T22:33:52.57935+08:00 INFO [14040,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server 2023-07-21T22:33:52.44995+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:52.98145+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:52.98121+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:52.98058+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1998369792e+10 Active_bytes:3.347748864e+10 Active_file_bytes:1.479118848e+09 AnonHugePages_bytes:2.9806821376e+10 AnonPages_bytes:3.199965184e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.035212288e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7125660672e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:626688 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57707264e+08 Inactive_file_bytes:5.40401664e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32456448e+08 MemAvailable_bytes:1.2471123968e+10 MemFree_bytes:1.4738280448e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.5069824e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.19308288e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11345408e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:52.99353+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=40.524613317000004, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:52.99975+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:53.11094+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:53.11167+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:33:54.04453+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:53.9637+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:53.84718+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:53.82089+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:53.92227+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:53.9238+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:53.92864+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:53.9208+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=14.3274641, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:53.1169+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:53.93328+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:53.93148+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:53.93207+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:53.93514+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=33.775410461, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:53.93199+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:53.93533+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:33:53.95364+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:53.95301+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=10.202010434, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:53.95491+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:53.95797+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:53.95841+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:53.95876+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:53.95523+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:33:53.96261+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:53.95535+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:53.96307+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:53.96329+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:53.96403+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=33.49 2023-07-21T22:33:53.96571+08:00 INFO [14040,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T22:33:27.11134+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.495893382, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:53.96497+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:27.10017+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1557087232e+10 Active_bytes:3.3035792384e+10 Active_file_bytes:1.478705152e+09 AnonHugePages_bytes:2.974810112e+10 AnonPages_bytes:3.155765248e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034757632e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6869644288e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:294912 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57662208e+08 Inactive_file_bytes:5.40356608e+08 KernelStack_bytes:2.3691264e+07 Mapped_bytes:1.32411392e+08 MemAvailable_bytes:1.2921909248e+10 MemFree_bytes:1.5189295104e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0646144e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18788096e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10825216e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:27.10218+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=5.467954048, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:27.11903+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=25.103756133, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:27.17439+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:27.10039+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=35.712669594, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:27.08735+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1570587648e+10 Active_bytes:3.3049214976e+10 Active_file_bytes:1.478627328e+09 AnonHugePages_bytes:2.9766975488e+10 AnonPages_bytes:3.1572484096e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034659328e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6886421504e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:196608 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57654016e+08 Inactive_file_bytes:5.40348416e+08 KernelStack_bytes:2.367488e+07 Mapped_bytes:1.3238272e+08 MemAvailable_bytes:1.2905459712e+10 MemFree_bytes:1.5172890624e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0515072e+07 SReclaimable_bytes:9.2033024e+07 SUnreclaim_bytes:1.18788096e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.1082112e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:53.96753+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:53.96869+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:53.98335+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:53.98372+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:53.98506+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:53.98451+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:53.98515+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:53.98547+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=23.56 2023-07-21T22:33:53.9857+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:53.99482+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.011976175, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:53.99674+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:27.17505+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:27.44486+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=56.54 2023-07-21T22:33:27.19786+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:53.99857+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:27.62704+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:27.19951+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:53.96659+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:27.48722+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000586279, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:54.01673+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:54.02382+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:27.69075+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:27.69233+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:27.69498+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:27.69584+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.745536532, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:54.0432+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.105167941, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:54.05839+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:32.42061+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.347948344, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:27.75264+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:27.76978+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:27.7753+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:27.97751+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:27.97772+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:27.97767+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.014614948, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:27.78953+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.029363123, err="couldn't get SNTP reply: read udp 127.0.0.1:9143->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:27.97855+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=15.878129221, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:09.98225+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:33:33.03286+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:54.05972+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:33:32.52642+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=30.49 2023-07-21T22:33:54.38996+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:54.42082+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:33.14467+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:33.14445+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:33.58701+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=20.20564796, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:33.58733+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:54.53627+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.006687826, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:54.65325+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:55.00927+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001019379, err="couldn't get SNTP reply: read udp 127.0.0.1:58960->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:54.52079+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=30.78 2023-07-21T22:33:55.00106+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.200207281, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:55.10617+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.531627389, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:54.99661+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:55.12035+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.323241408, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:55.88014+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:54.68446+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.075279369, err="couldn't get SNTP reply: read udp 127.0.0.1:54185->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:56.48361+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:56.48138+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:56.47803+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:56.498+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:56.48214+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:56.49821+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:56.56836+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=29.538553964, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:56.62485+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.022996347, err="couldn't get SNTP reply: read udp 127.0.0.1:24691->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:56.55138+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:56.94567+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:57.15119+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:56.47539+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.662181904, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:56.87235+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:56.62503+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:57.15176+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:57.15595+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:57.47129+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:56.46509+08:00 INFO [14040,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server_resource 2023-07-21T22:33:57.41977+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:57.57182+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:58.10287+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:58.1059+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=32.03 2023-07-21T22:33:58.10168+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:57.48848+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.825160719, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:57.47176+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=61.21 2023-07-21T22:33:58.10082+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001144768, err="couldn't get SNTP reply: read udp 127.0.0.1:23358->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:57.61665+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=57.95508418, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:58.3076+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:58.34892+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:58.35184+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=30.78 2023-07-21T22:33:58.34737+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:58.3584+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:58.11837+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:58.36816+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:57.47606+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:58.3661+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:58.36652+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:58.37201+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:58.37205+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:57.15724+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:58.36198+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.010763156, err="couldn't get SNTP reply: read udp 127.0.0.1:27987->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:58.3786+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=61.21 2023-07-21T22:33:58.37496+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.013701415, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:58.35896+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=58.718093323, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:58.36604+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:58.36195+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:58.38453+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.082344605, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:58.30004+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:58.48784+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:58.34606+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:58.49045+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:58.14299+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:58.60886+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=35.449568096, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:58.87067+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.510439567, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:58.8712+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:58.84852+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:58.87044+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:58.79258+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:58.91071+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:33:57.15076+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:59.63308+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.63471+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.64392+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.64579+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.64693+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.64754+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.64827+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.039850309, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:33:59.28753+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:33:59.59953+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:59.25192+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:58.91543+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:59.07668+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:33:59.67138+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:33:59.66247+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:33:56.48403+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.15271+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:59.15601+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.22399+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.4 2023-07-21T22:33:59.16667+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:59.15506+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.26 2023-07-21T22:33:59.21822+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.16004+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.33462+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.2875+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:59.39516+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.42428+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.89 2023-07-21T22:33:59.28629+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:59.42528+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:59.42492+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=35.22 2023-07-21T22:33:59.43615+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.4 2023-07-21T22:33:59.45885+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:59.47391+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=35.22 2023-07-21T22:33:59.4782+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:59.53995+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:59.47769+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:54.34072+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:59.28702+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:59.47113+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:59.49657+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.67295+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:59.47291+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:59.67203+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:59.47076+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:33.08392+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.245918945, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:59.70707+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:59.70725+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:33.6157+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:33.64334+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:33.59225+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:59.73731+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:33.65264+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:33.65202+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:31.03875+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:56.06553+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=61.21 2023-07-21T22:33:56.0366+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:59.83396+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:33:59.83451+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:33:56.05998+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.83796+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:33.82095+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.25 2023-07-21T22:33:33.8222+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:59.84713+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:33:59.85308+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:33.79092+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:34.02643+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1667830784e+10 Active_bytes:3.314663424e+10 Active_file_bytes:1.478803456e+09 AnonHugePages_bytes:2.9762781184e+10 AnonPages_bytes:3.1668944896e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.03485184e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6923715584e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:249856 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57666304e+08 Inactive_file_bytes:5.40360704e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.3242368e+08 MemAvailable_bytes:1.280919552e+10 MemFree_bytes:1.5076532224e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.144896e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18890496e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10927616e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:59.85272+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:34.02807+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=21.61 2023-07-21T22:33:33.87754+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:34.045+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T22:33:34.04536+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:59.85399+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:59.86874+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup 2023-07-21T22:34:00.10826+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=60.237162279, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:35.10629+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:35.1304+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:35.13064+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=36.575904605, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:35.12289+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:34:00.1184+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:35.13079+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:00.14293+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=45.363824996, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:35.12246+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=3.0212383, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:34:00.14605+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:34:00.15659+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:34:00.15681+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:34:00.3239+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:34:00.32274+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:35.25073+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.25 2023-07-21T22:33:35.29036+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:33:35.29233+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:35.2928+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:35.18869+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:35.30574+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:35.2452+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:34:00.41658+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:00.45321+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=45.280612282, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:35.29289+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:35.35059+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=23.283102726, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:35.35061+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:35.35144+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:35.3349+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:34:00.49489+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:00.52165+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:35.35208+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:35.35143+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:35.33521+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:33:35.34988+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:35.13165+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=30.78 2023-07-21T22:33:11.01378+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:34.1572+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:34.06736+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:34.38365+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:34.38321+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:11.01115+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:34.0647+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=30.11 2023-07-21T22:33:34.62575+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, `latch#` as latch_no, name, gets, misses, sleeps, immediate_gets, immediate_misses, spin_gets, wait_time / 1000000 as wait_time from v$latch, __all_tenant where __all_tenant.tenant_id = v$latch.con_id 2023-07-21T22:34:00.58693+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1765368832e+10 Active_bytes:3.3244250112e+10 Active_file_bytes:1.47888128e+09 AnonHugePages_bytes:2.976907264e+10 AnonPages_bytes:3.1762976768e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034925568e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6977946624e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:339968 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57662208e+08 Inactive_file_bytes:5.40356608e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32427776e+08 MemAvailable_bytes:1.2711268352e+10 MemFree_bytes:1.4978568192e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2194432e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.1892736e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.1096448e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:34.62665+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:11.01622+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:34.34537+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:34.15686+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:34.33584+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:34.38875+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=19.557372831, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:34.688+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.594976307, err="couldn't get SNTP reply: read udp 127.0.0.1:48078->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:11.40486+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:34.06472+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:11.40604+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:34.8004+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:34.72857+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:33:34.80552+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.034262074, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:34.68757+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:34:00.61889+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=61.21 2023-07-21T22:33:11.53957+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:34.38515+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:34.80741+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:11.54001+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:11.54008+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.62 2023-07-21T22:34:00.62427+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:47.08263+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:31.10659+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=30.49 2023-07-21T22:34:16.98516+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T22:33:31.10517+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:49.53327+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.003180541, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:47.09076+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=18.145047637, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:34:16.95675+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:34:16.99726+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:33:31.54787+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:09.44976+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:34:17.54662+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:34:17.55473+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:34:17.56166+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/kernel/security 2023-07-21T22:34:17.5623+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:34:17.55441+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:33:11.6978+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:00.70767+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:34:00.71684+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:34:00.72533+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=61.21 2023-07-21T22:34:00.70963+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=33.27904163, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:11.69361+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:39.1777+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=34.196278694, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:34:00.73315+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.2134230016e+10 Active_bytes:3.3613541376e+10 Active_file_bytes:1.47931136e+09 AnonHugePages_bytes:2.9798432768e+10 AnonPages_bytes:3.2130555904e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.03538432e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7213548544e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:253952 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.5769088e+08 Inactive_file_bytes:5.4038528e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32468736e+08 MemAvailable_bytes:1.2330242048e+10 MemFree_bytes:1.4597300224e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.7179264e+07 SReclaimable_bytes:9.20576e+07 SUnreclaim_bytes:1.19640064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11697664e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:34:00.73567+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=24.23 2023-07-21T22:34:00.73662+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=40.701766189, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:34:00.73853+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.503925561, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:34:00.75861+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:39.23491+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:34:00.87843+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:34:00.88267+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.004298745, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:34:00.85229+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:00.94135+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001995281, err="couldn't get SNTP reply: read udp 127.0.0.1:52673->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:34:01.05652+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=22.517901834, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:34:01.06538+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=24.23 2023-07-21T22:34:01.05695+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=25.531108394, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:11.77681+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:34:01.06894+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.012040106, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:34:01.10837+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=33.397669592, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:34:01.26209+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.051085009, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:34:01.27657+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:34:01.53833+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.44602366, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:34:01.58183+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:34:01.10625+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.027037669, err="couldn't get SNTP reply: read udp 127.0.0.1:52314->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:34:01.53983+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:34:01.73678+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:39.24444+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:33:11.76162+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=4.036454898, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:34:01.79234+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.021991388, err="couldn't get SNTP reply: read udp 127.0.0.1:16205->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:34:01.27707+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.2157216768e+10 Active_bytes:3.3636552704e+10 Active_file_bytes:1.479335936e+09 AnonHugePages_bytes:2.9815209984e+10 AnonPages_bytes:3.2157085696e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.035412992e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7232586752e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:282624 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57699072e+08 Inactive_file_bytes:5.40393472e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32481024e+08 MemAvailable_bytes:1.2308652032e+10 MemFree_bytes:1.4575693824e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.728576e+07 SReclaimable_bytes:9.20576e+07 SUnreclaim_bytes:1.19640064e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11697664e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:34:02.89465+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:34:02.94596+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:34:01.79587+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.009255269, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:11.73159+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:02.9467+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:34:01.80605+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.966791713, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:34:03.20895+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:34:03.21199+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:03.23422+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:34:03.24233+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:12.59396+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:12.5938+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:34:03.24042+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.372425021, err="couldn't get SNTP reply: read udp 127.0.0.1:20393->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:12.59496+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:34:03.23417+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:12.59463+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:12.27727+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.62 2023-07-21T22:33:12.68643+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.001335499, err="couldn't get SNTP reply: read udp 127.0.0.1:60086->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:34:03.77827+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:34:03.88155+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=24.74632848, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:34:04.14183+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.355228207, err="couldn't get SNTP reply: read udp 127.0.0.1:21621->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:34:04.42167+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:34:04.15574+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.285559667, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:34:04.3735+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:04.40795+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:04.1414+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=59.19 2023-07-21T22:34:00.75956+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:34:01.69125+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:34:04.14164+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:00.7619+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:34:02.53467+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.249273129, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:35.44721+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:35.44732+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:35.41523+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:34:00.85218+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu3, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:39.43026+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:34:00.84414+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=46.009230687, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:34:00.75921+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:35.50617+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ zone, name, value, time_to_usec(now()) as current from __all_zone 2023-07-21T22:33:35.44653+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, tenant_id, stat_id, value from v$sysstat, __all_tenant where stat_id IN (10000, 10001, 10002, 10003, 10005, 10006, 140002, 140003, 140005, 140006, 60019, 60020, 60024, 80040, 80041, 130000, 130001, 130002, 130004, 20001, 20002, 30000, 30001, 30002, 30005, 30006, 40000, 40001, 40002, 40003, 40004, 40005, 40006, 40007, 40008, 40009, 40010, 40011, 40012, 50000, 50001, 50008, 50009, 60000, 60001, 60002, 60003, 60004, 60005, 60019, 60020, 60021, 60022, 60023, 60024, 80057) and (con_id > 1000 or con_id = 1) and __all_tenant.tenant_id = v$sysstat.con_id and class < 1000 2023-07-21T22:33:12.88285+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:34:00.75996+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:35.49162+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1710744576e+10 Active_bytes:3.3189597184e+10 Active_file_bytes:1.478852608e+09 AnonHugePages_bytes:2.976907264e+10 AnonPages_bytes:3.1710912512e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034896896e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6943638528e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:294912 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57662208e+08 Inactive_file_bytes:5.40356608e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32427776e+08 MemAvailable_bytes:1.2766302208e+10 MemFree_bytes:1.5033614336e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.189952e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18919168e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10956288e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:34:04.89972+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:35.45145+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.037843804, err="couldn't get SNTP reply: read udp 127.0.0.1:49771->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:35.36438+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:27.05876+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:35.49709+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:34:02.34884+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=59.19 2023-07-21T22:33:35.54047+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.175746167, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:34:04.76324+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.014598851, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:35.53944+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.355348994, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:35.53458+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1711117312e+10 Active_bytes:3.318996992e+10 Active_file_bytes:1.478852608e+09 AnonHugePages_bytes:2.976907264e+10 AnonPages_bytes:3.1711469568e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034896896e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6944162816e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:294912 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57662208e+08 Inactive_file_bytes:5.40356608e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32427776e+08 MemAvailable_bytes:1.2765855744e+10 MemFree_bytes:1.5033167872e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.189952e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18919168e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10956288e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:35.54344+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.000718778, err="couldn't get SNTP reply: read udp 127.0.0.1:22850->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:35.49358+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:33:35.54863+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=23.722818113, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:34:05.12086+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:34:05.12253+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:36.01017+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:36.22403+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.978648234, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:34:05.13126+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:36.17079+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from V$OB_PLAN_CACHE_STAT join __all_tenant on V$OB_PLAN_CACHE_STAT.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:33:36.55151+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:36.00942+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=20.377093603, err="couldn't get SNTP reply: read udp 127.0.0.1:45956->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:36.04647+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T22:34:04.6432+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:30.78714+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:46.74956+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:36.55455+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:30.87452+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:35.55424+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:30.88969+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:46.75483+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:36.55496+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.061482019, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:36.17065+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:36.55471+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, cache_name, cache_size from __all_virtual_kvcache_info, __all_tenant where __all_tenant.tenant_id = __all_virtual_kvcache_info.tenant_id and svr_ip = ? and svr_port = ? 2023-07-21T22:33:36.38464+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:36.55193+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:36.6263+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.07831683, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:30.98869+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:46.76317+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:46.7634+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:34:04.37537+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.689765336, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:34:04.87637+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:46.75971+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:46.76477+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:46.76483+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:46.77006+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1580123136e+10 Active_bytes:3.305887744e+10 Active_file_bytes:1.478754304e+09 AnonHugePages_bytes:2.974810112e+10 AnonPages_bytes:3.1579541504e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034782208e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6882751488e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:319488 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57654016e+08 Inactive_file_bytes:5.40348416e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32419584e+08 MemAvailable_bytes:1.2894650368e+10 MemFree_bytes:1.5162015744e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.0797696e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18788096e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10825216e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:46.76564+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:05.13423+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:36.01039+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:46.7706+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:46.76395+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda6, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:46.77847+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:36.71633+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:31.04889+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:46.77773+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:31.07315+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:46.78116+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:31.05255+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:46.77933+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:36.71935+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.397119477, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:36.72444+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=14.650303261, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:36.2043+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=51.27 2023-07-21T22:33:31.10039+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=23.765094287, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:31.10421+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.25 2023-07-21T22:33:46.78923+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:46.77948+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:31.03855+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:46.94157+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:36.55431+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:36.55174+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:36.32233+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:36.04653+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ __all_tenant.tenant_name as tenant_name, cast(v_acc_response_time.response_time / 1000000 as float) as response_time_seconds, v_acc_response_time.count as bucket, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then v_acc_response_time.count else null end as count, case when v_acc_response_time.response_time = (select max(response_time) from __all_virtual_query_response_time) then cast(v_acc_response_time.sum / 1000000 as float) else null end as sum from (select b.tenant_id, b.response_time as response_time, sum(a.count) as count, sum(a.total) as sum from __all_virtual_query_response_time a, __all_virtual_query_response_time b where a.response_time <= b.response_time and a.svr_ip = b.svr_ip and a.svr_port = b.svr_port and b.svr_ip = ? and b.svr_port = ? group by b.tenant_id, b.response_time) v_acc_response_time, __all_tenant where v_acc_response_time.tenant_id = __all_tenant.tenant_id; 2023-07-21T22:33:36.79885+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ with_rootserver from __all_server where svr_ip = ? and svr_port = ? 2023-07-21T22:33:36.8001+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^4' as ob_is_v4 2023-07-21T22:33:37.05247+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:37.0529+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:31.07477+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:37.09691+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu15, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:36.32571+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:36.73852+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1713247232e+10 Active_bytes:3.3192103936e+10 Active_file_bytes:1.478856704e+09 AnonHugePages_bytes:2.976907264e+10 AnonPages_bytes:3.171407872e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034896896e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.694835712e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:294912 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57662208e+08 Inactive_file_bytes:5.40356608e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32427776e+08 MemAvailable_bytes:1.2762353664e+10 MemFree_bytes:1.5029665792e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.189952e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18919168e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10956288e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:37.09743+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu1, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:33:35.49505+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ tenant_name, mem_used, access_count, hit_count from v$plan_cache_stat join __all_tenant on v$plan_cache_stat.tenant_id = __all_tenant.tenant_id group by tenant_name 2023-07-21T22:33:37.15823+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select ob_version() REGEXP '^3' as ob_is_v3 2023-07-21T22:33:36.76446+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.229986539, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:31.00622+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:37.15366+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:34:51.77528+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.165760739, err="couldn't get SNTP reply: read udp 127.0.0.1:62264->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:37.10343+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu3, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:34:04.62286+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:37.24434+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=22.045650797, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:46.78917+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:36.73978+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1725113344e+10 Active_bytes:3.320397824e+10 Active_file_bytes:1.478864896e+09 AnonHugePages_bytes:2.976907264e+10 AnonPages_bytes:3.1726641152e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.03491328e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6955172864e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:311296 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57666304e+08 Inactive_file_bytes:5.40360704e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32427776e+08 MemAvailable_bytes:1.2752084992e+10 MemFree_bytes:1.5019388928e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2014208e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18919168e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10956288e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:37.15164+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:46.82247+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:37.24014+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:12.7323+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:40.42191+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:47.07594+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:47.08342+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=25.826669811, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:47.08739+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=59.930913128, fields.level=debug, fields.msg="collector succeeded", name=filesystem 2023-07-21T22:33:47.07585+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.89 2023-07-21T22:33:31.19578+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=24.617530359, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:31.23587+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:31.19585+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:40.45243+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:46.76363+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:31.23805+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=24.1871248, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:31.13361+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu11, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:34:16.8877+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:47.07508+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:34:16.9102+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:47.09762+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:31.58335+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=22.364930088, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:31.75477+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:31.25387+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:31.23577+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=22.228286754, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:31.64616+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=22.425996424, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:31.64724+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.25 2023-07-21T22:33:31.60459+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:17.55073+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ count(*) as cnt from v$unit 2023-07-21T22:34:05.14323+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda1, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:49.54958+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:31.70655+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1423614976e+10 Active_bytes:3.2902017024e+10 Active_file_bytes:1.478402048e+09 AnonHugePages_bytes:2.9746003968e+10 AnonPages_bytes:3.1424090112e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034429952e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.678752768e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:532480 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57645824e+08 Inactive_file_bytes:5.40340224e+08 KernelStack_bytes:2.3658496e+07 Mapped_bytes:1.32022272e+08 MemAvailable_bytes:1.3063692288e+10 MemFree_bytes:1.5331250176e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.7815808e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18542336e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.1055488e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:47.14442+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/pstore 2023-07-21T22:34:05.22443+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:31.79187+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.579137681, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:31.86146+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:34:05.38454+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:34:05.39773+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:34:05.60667+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:34:05.95321+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:34:05.89051+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:34:05.70881+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.514746368, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:34:05.38389+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:17.57178+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:34:06.01255+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:34:06.01373+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.451672896, err="couldn't get SNTP reply: read udp 127.0.0.1:63809->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:40.61063+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu20, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:34:06.05424+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:31.83367+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:34:05.90971+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:34:06.13732+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=57.17 2023-07-21T22:33:47.26949+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu2, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:34:06.14628+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:40.8513+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:05.20003+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:06.20271+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:06.16316+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:40.85137+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:06.28654+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:06.1467+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:34:06.34007+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:40.95303+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:34:06.75103+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:34:06.76122+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:34:06.76157+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:06.76142+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:06.76362+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:40.95378+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:32.4666+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.48192438, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:40.95363+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:41.06652+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.740425955, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:34:07.15908+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=1, load=31.96 2023-07-21T22:33:54.06627+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.120547764, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:41.91135+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:41.63958+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:34:07.21734+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/shm 2023-07-21T22:33:32.64961+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:32.64292+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=24.439394289, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:34:07.27481+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:32.7806+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:32.68562+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=26.18603204, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:34:07.33276+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=33.414873583, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:32.68396+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:34:07.33306+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:32.79572+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:32.79246+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:32.77797+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.006235295, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:32.80341+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:32.79708+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.25 2023-07-21T22:33:32.93264+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:33.02624+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.246098163, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:41.98744+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:42.10405+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:41.98958+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:42.20477+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:42.20459+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:42.21189+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=2, load=22.1 2023-07-21T22:34:07.36553+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:42.2108+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:42.47277+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:42.63117+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:42.47418+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.5688472989999998, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:42.38551+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:34:07.45944+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=68.508787153, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:42.38662+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:42.63062+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:42.75947+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:42.63117+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.121470718, err="couldn't get SNTP reply: read udp 127.0.0.1:7311->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:33.02657+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:34:07.50769+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:32.4129+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=54.25 2023-07-21T22:33:33.05537+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:33.05543+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:33.05566+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:33.04743+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.125807922, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:33.05672+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:33.02836+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:33.05834+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=24.145990429, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:33.03459+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:33.05896+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:32.79558+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=23.416321921, err="couldn't get SNTP reply: read udp 127.0.0.1:32084->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:33.06614+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.969486412, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:32.93424+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.167154176e+10 Active_bytes:3.3150332928e+10 Active_file_bytes:1.478791168e+09 AnonHugePages_bytes:2.9771169792e+10 AnonPages_bytes:3.166287872e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.03483136e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.693262848e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:225280 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57662208e+08 Inactive_file_bytes:5.40356608e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32419584e+08 MemAvailable_bytes:1.280581632e+10 MemFree_bytes:1.5073161216e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.126464e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18870016e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10907136e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:32.91881+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:07.50797+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:54.14437+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu12, fields.level=debug, fields.msg="CPU is missing core_throttle_count" 2023-07-21T22:33:54.16979+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:33.11736+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:54.17207+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:33.0864+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=23.870576076, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:32.78822+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.002041287, err="couldn't get SNTP reply: read udp 127.0.0.1:57346->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:33:54.38359+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=61.14 2023-07-21T22:33:54.16976+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:48.24164+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:07.53033+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:07.43767+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:34.05172+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:34:07.55005+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=6.6660558309999995, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:34:07.65848+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:48.30986+08:00 INFO [14040,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server 2023-07-21T22:34:00.15701+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:48.36499+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:48.31047+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1688282112e+10 Active_bytes:3.3167110144e+10 Active_file_bytes:1.478828032e+09 AnonHugePages_bytes:2.9764878336e+10 AnonPages_bytes:3.1688773632e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034868224e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6932104192e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:266240 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57662208e+08 Inactive_file_bytes:5.40356608e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.3242368e+08 MemAvailable_bytes:1.27888384e+10 MemFree_bytes:1.5056162816e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.169472e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18898688e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.10935808e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:48.49598+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:48.56683+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:48.5092+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1937384448e+10 Active_bytes:3.3416445952e+10 Active_file_bytes:1.479061504e+09 AnonHugePages_bytes:2.979004416e+10 AnonPages_bytes:3.1940493312e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.035130368e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7076017152e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:544768 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57686784e+08 Inactive_file_bytes:5.40381184e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32456448e+08 MemAvailable_bytes:1.2532781056e+10 MemFree_bytes:1.4799978496e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.4332544e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.19218176e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11255296e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:48.4959+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:34:00.2329+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:48.54333+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.149385728e+10 Active_bytes:3.2972357632e+10 Active_file_bytes:1.478500352e+09 AnonHugePages_bytes:2.9752295424e+10 AnonPages_bytes:3.1494647808e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.03452416e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.6833304576e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:602112 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.5764992e+08 Inactive_file_bytes:5.4034432e+08 KernelStack_bytes:2.3642112e+07 Mapped_bytes:1.3207552e+08 MemAvailable_bytes:1.2989149184e+10 MemFree_bytes:1.525665792e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:7.921664e+07 SReclaimable_bytes:9.2012544e+07 SUnreclaim_bytes:1.18685696e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.1069824e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:33:48.66368+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=20.363042361, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:34:00.23341+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:48.66424+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.327062773, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:48.6627+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:35.15186+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=20.300795097, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:33:48.67726+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.437685028, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:35.15251+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:48.79483+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=38.659584062, fields.level=debug, fields.msg="collector succeeded", name=loadavg 2023-07-21T22:33:48.82005+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev 2023-07-21T22:33:48.83985+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda7, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:48.82576+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=14.759460769, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:48.82809+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:48.8444+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:41.32157+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:41.46529+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:48.84082+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:48.84062+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:41.39208+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=1.7781368739999999, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:33:41.4616+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.182942208e+10 Active_bytes:3.3308336128e+10 Active_file_bytes:1.478914048e+09 AnonHugePages_bytes:2.9785849856e+10 AnonPages_bytes:3.1826444288e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.034982912e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7031227392e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:401408 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.576704e+08 Inactive_file_bytes:5.403648e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.3244416e+08 MemAvailable_bytes:1.2637691904e+10 MemFree_bytes:1.4904971264e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.2968576e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.18972416e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11009536e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:34:08.33516+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:41.58641+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:41.52196+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:48.91114+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.6449346719999998, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:33:41.58633+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:48.91042+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:41.67905+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:48.91276+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:33:41.67871+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=49.73 2023-07-21T22:33:48.91446+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.354431031, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:33:48.92809+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:41.67774+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:34:00.23362+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:48.91564+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:49.00494+08:00 INFO [14040,] caller=mysql/table_input.go:176:doUpdateCache: got update cache task for metric:ob_server 2023-07-21T22:33:48.91451+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:33:48.84539+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_role 2023-07-21T22:33:48.99768+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.1949664256e+10 Active_bytes:3.3428742144e+10 Active_file_bytes:1.479077888e+09 AnonHugePages_bytes:2.9787947008e+10 AnonPages_bytes:3.1949463552e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.035142656e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7082472448e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:557056 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57682688e+08 Inactive_file_bytes:5.40377088e+08 KernelStack_bytes:2.3707648e+07 Mapped_bytes:1.32456448e+08 MemAvailable_bytes:1.2520763392e+10 MemFree_bytes:1.478795264e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.4566016e+07 SReclaimable_bytes:9.203712e+07 SUnreclaim_bytes:1.19230464e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11267584e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:34:08.49148+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:48.86618+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/proc 2023-07-21T22:33:49.00499+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:34:08.97081+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.111897242, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:33:36.7263+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=cpu, cpu=/sys/devices/system/cpu/cpu0, fields.level=debug, fields.msg="CPU is missing package_throttle_count" 2023-07-21T22:34:16.65892+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:34:09.0269+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:34:08.97119+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.348664212, err="couldn't get SNTP reply: read udp 127.0.0.1:58461->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:34:09.40677+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda2, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:33:49.0678+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=2.619463089, fields.level=debug, fields.msg="collector succeeded", name=meminfo 2023-07-21T22:34:16.98993+08:00 WARN [14040,] caller=mysql/table_input.go:202:collectData: slow collect sql: select /*+ MONITOR_AGENT READ_CONSISTENCY(WEAK) */ sum(hold) as hold, sum(used) as used from __all_virtual_memory_info where tenant_id = 500 and svr_ip = ? and svr_port = ? 2023-07-21T22:34:16.8735+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda3, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:17.0798+08:00 WARN [14040,] caller=engine/route_manager.go:193:pipelinePull: pull pipeline parallel compute result metrics is nil 2023-07-21T22:33:49.97616+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=56.8 2023-07-21T22:33:49.59658+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.126246783, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:34:16.93815+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_index 2023-07-21T22:34:17.07968+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:34:09.24247+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_table 2023-07-21T22:33:49.59358+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.143468406, err="couldn't get SNTP reply: read udp 127.0.0.1:49403->127.0.0.1:123: read: connection refused", fields.level=error, fields.msg="collector failed", name=ntp 2023-07-21T22:34:09.41427+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=0.43090806, fields.level=debug, fields.msg="collector succeeded", name=sockstat 2023-07-21T22:34:10.35408+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:34:09.42304+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=loadavg, fields.level=debug, fields.msg="return load", index=0, load=57.17 2023-07-21T22:34:10.97211+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=27.077490621, fields.level=debug, fields.msg="collector succeeded", name=netstat 2023-07-21T22:34:11.01056+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:33:50.01359+08:00 WARN [14040,] caller=mysql/table_input.go:291:doCollect: condition not satisfied, skip do collect for:ob_trans 2023-07-21T22:34:10.76644+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:34:11.05177+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:11.07517+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda4, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:17.08016+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=diskstats, device=sda5, fields.level=debug, fields.msg="Ignoring device" 2023-07-21T22:34:11.0791+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:11.07979+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=31.648663094, fields.level=debug, fields.msg="collector succeeded", name=netdev 2023-07-21T22:34:11.07049+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=meminfo, fields.level=debug, fields.msg="Set node_mem", memInfo="map[Active_anon_bytes:3.2194039808e+10 Active_bytes:3.3673494528e+10 Active_file_bytes:1.47945472e+09 AnonHugePages_bytes:2.9794238464e+10 AnonPages_bytes:3.2193466368e+10 Bounce_bytes:0 Buffers_bytes:2.134016e+06 Cached_bytes:2.035531776e+09 CmaFree_bytes:0 CmaTotal_bytes:0 CommitLimit_bytes:2.908071936e+10 Committed_AS_bytes:3.7254606848e+10 DirectMap2M_bytes:5.0319065088e+10 DirectMap4k_bytes:1.220411392e+09 Dirty_bytes:249856 HardwareCorrupted_bytes:0 HugePages_Free:0 HugePages_Rsvd:0 HugePages_Surp:0 HugePages_Total:0 Hugepagesize_bytes:2.097152e+06 Inactive_anon_bytes:1.73056e+07 Inactive_bytes:5.57699072e+08 Inactive_file_bytes:5.40393472e+08 KernelStack_bytes:2.3691264e+07 Mapped_bytes:1.3248512e+08 MemAvailable_bytes:1.226938368e+10 MemFree_bytes:1.4536359936e+10 MemTotal_bytes:4.957151232e+10 Mlocked_bytes:0 NFS_Unstable_bytes:0 PageTables_bytes:8.8469504e+07 SReclaimable_bytes:9.2065792e+07 SUnreclaim_bytes:1.19754752e+08 Shmem_bytes:1.7813504e+07 Slab_bytes:2.11820544e+08 SwapCached_bytes:0 SwapFree_bytes:4.2949632e+09 SwapTotal_bytes:4.2949632e+09 Unevictable_bytes:0 VmallocChunk_bytes:3.515779487744e+13 VmallocTotal_bytes:3.5184372087808e+13 VmallocUsed_bytes:2.67952128e+08 WritebackTmp_bytes:0 Writeback_bytes:0]" 2023-07-21T22:34:11.07019+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:34:11.08872+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys/fs/cgroup/systemd 2023-07-21T22:34:11.16781+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:50.02055+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:33:50.24322+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/sys 2023-07-21T22:33:50.01369+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev/pts 2023-07-21T22:34:11.17056+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin mysqlTableInput collect time out" 2023-07-21T22:34:11.17501+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=25.824718656, fields.level=debug, fields.msg="collector succeeded", name=filefd 2023-07-21T22:34:11.17777+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: duration_seconds=67.105232845, fields.level=debug, fields.msg="collector succeeded", name=diskstats 2023-07-21T22:34:11.13298+08:00 ERROR [14040,] caller=engine/pipeline.go:154:collectAndProcess: input plugin collect failed fields: error="input plugin nodeExporterInput collect time out" 2023-07-21T22:34:11.19768+08:00 INFO [14040,] caller=logrus/logrus_logger.go:33:Log: fields: collector=filesystem, fields.level=debug, fields.msg="Ignoring mount point", mountpoint=/dev