2024-12-31 18:13:38.078 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:13:45.794 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:13:45.794 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:13:45.837 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:13:45.838 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:13:45.838 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:13:46.045 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:13:48.274 INFO 28706 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : begin AfterDataSourceCreationHook 2024-12-31 18:13:48.280 INFO 28706 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : end AfterDataSourceCreationHook 2024-12-31 18:13:49.932 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT12.758646035S 2024-12-31 18:13:50.070 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:13:50.385 INFO 28706 --- [main,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2024-12-31 18:13:50.386 INFO 28706 --- [main,,] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2024-12-31 18:13:50.520 INFO 28706 --- [main,,] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 2024-12-31 18:13:50.660 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:13:50.660 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:13:50.660 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:13:50.660 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:13:50.660 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:13:50.662 INFO 28706 --- [main,,] c.oceanbase.ocp.OcpCeServerApplication : The following 1 profile is active: "composite" 2024-12-31 18:13:50.678 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:13:59.092 INFO 28706 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Multiple Spring Data modules found, entering strict repository configuration mode 2024-12-31 18:13:59.093 INFO 28706 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2024-12-31 18:13:59.287 INFO 28706 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 169 ms. Found 4 JPA repository interfaces. 2024-12-31 18:13:59.298 INFO 28706 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Multiple Spring Data modules found, entering strict repository configuration mode 2024-12-31 18:13:59.298 INFO 28706 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2024-12-31 18:13:59.528 INFO 28706 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 230 ms. Found 16 JPA repository interfaces. 2024-12-31 18:13:59.529 INFO 28706 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Multiple Spring Data modules found, entering strict repository configuration mode 2024-12-31 18:13:59.530 INFO 28706 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2024-12-31 18:14:00.886 INFO 28706 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 1356 ms. Found 157 JPA repository interfaces. 2024-12-31 18:14:04.138 INFO 28706 --- [main,,] o.s.cloud.context.scope.GenericScope : BeanFactory id=0f233f8c-7d1e-3396-84b4-7fa06161d9e7 2024-12-31 18:14:06.290 INFO 28706 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'commonSecurityConfiguration.MethodSecurityConfiguration' of type [com.oceanbase.ocp.server.common.config.security.conf.CommonSecurityConfiguration$MethodSecurityConfiguration$$EnhancerBySpringCGLIB$$dbcfa013] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2024-12-31 18:14:06.310 INFO 28706 --- [main,,] .o.s.c.c.s.c.CommonSecurityConfiguration : Method-level access control enabled. 2024-12-31 18:14:07.146 INFO 28706 --- [main,,] c.o.o.s.c.c.w.MetadbHikariConfigHelper : [metadb] driver class=com.oceanbase.jdbc.Driver 2024-12-31 18:14:07.146 INFO 28706 --- [main,,] c.o.o.s.c.c.w.MetadbHikariConfigHelper : [metadb] username=root@ocp_meta 2024-12-31 18:14:07.146 INFO 28706 --- [main,,] c.o.o.s.c.c.w.MetadbHikariConfigHelper : [metadb] jdbc url=jdbc:oceanbase://10.79.169.37:2881/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull 2024-12-31 18:14:07.163 INFO 28706 --- [main,,] com.zaxxer.hikari.HikariDataSource : metadb-connect-pool - Starting... 2024-12-31 18:14:07.244 INFO 28706 --- [main,,] com.zaxxer.hikari.HikariDataSource : metadb-connect-pool - Start completed. 2024-12-31 18:14:07.254 INFO 28706 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : begin AfterDataSourceCreationHook 2024-12-31 18:14:07.255 INFO 28706 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : end AfterDataSourceCreationHook 2024-12-31 18:14:07.299 INFO 28706 --- [main,,] c.o.o.c.distributed.server.LocalServer : Local server, id=10.79.169.37:8090, name=a9efd8d51e 2024-12-31 18:14:07.400 INFO 28706 --- [main,,] c.o.o.c.d.s.DistributedServerManager : DistributedServer updater scheduler started on 10.79.169.37:8090 2024-12-31 18:14:08.480 INFO 28706 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8090 (http) 2024-12-31 18:14:08.506 INFO 28706 --- [main,,] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2024-12-31 18:14:08.506 INFO 28706 --- [main,,] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.83] 2024-12-31 18:14:08.697 INFO 28706 --- [main,,] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2024-12-31 18:14:08.697 INFO 28706 --- [main,,] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 18019 ms 2024-12-31 18:14:09.605 INFO 28706 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2024-12-31 18:14:09.972 INFO 28706 --- [main,,] org.hibernate.Version : HHH000412: Hibernate ORM core version 5.6.15.Final 2024-12-31 18:14:10.865 INFO 28706 --- [main,,] o.hibernate.annotations.common.Version : HCANN000001: Hibernate Commons Annotations {5.1.2.Final} 2024-12-31 18:14:15.040 INFO 28706 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2024-12-31 18:14:16.689 WARN 28706 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2024-12-31 18:14:18.009 WARN 28706 --- [main,,] org.hibernate.mapping.RootClass : HHH000038: Composite-id class does not override equals(): com.oceanbase.ocp.core.metadb.repo.iam.jdbcsession.SpringJdbcSessionAttributeKey 2024-12-31 18:14:18.009 WARN 28706 --- [main,,] org.hibernate.mapping.RootClass : HHH000039: Composite-id class does not override hashCode(): com.oceanbase.ocp.core.metadb.repo.iam.jdbcsession.SpringJdbcSessionAttributeKey 2024-12-31 18:14:22.618 INFO 28706 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2024-12-31 18:14:22.699 INFO 28706 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2024-12-31 18:14:25.002 INFO 28706 --- [main,,] c.o.o.monitor.MonitorBeanConfiguration : ocp-monitor bean configuration done 2024-12-31 18:14:25.772 INFO 28706 --- [main,,] c.o.ocp.ha.maz.OcpMultiAzoneServiceImpl : OCP multi-azone not enabled 2024-12-31 18:14:25.785 INFO 28706 --- [main,,] .o.o.s.c.c.w.MonitordbHikariConfigHelper : [monitordb] driver class=com.oceanbase.jdbc.Driver 2024-12-31 18:14:25.785 INFO 28706 --- [main,,] .o.o.s.c.c.w.MonitordbHikariConfigHelper : [monitordb] username=root@ocp_monitor 2024-12-31 18:14:25.785 INFO 28706 --- [main,,] .o.o.s.c.c.w.MonitordbHikariConfigHelper : [monitordb] jdbc url=jdbc:oceanbase://10.79.169.37:2881/monitor_database?useUnicode=true&characterEncoding=utf-8&encloseParamInParentheses=false&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull 2024-12-31 18:14:25.785 INFO 28706 --- [main,,] com.zaxxer.hikari.HikariDataSource : monitor-connect-pool - Starting... 2024-12-31 18:14:25.791 INFO 28706 --- [main,,] com.zaxxer.hikari.HikariDataSource : monitor-connect-pool - Start completed. 2024-12-31 18:14:25.791 INFO 28706 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : begin AfterDataSourceCreationHook 2024-12-31 18:14:25.791 INFO 28706 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : end AfterDataSourceCreationHook 2024-12-31 18:14:25.840 INFO 28706 --- [main,,] .o.s.c.c.w.ConfigServerDataSourceWrapper : [config server datasource] driver class=com.oceanbase.jdbc.Driver 2024-12-31 18:14:25.840 INFO 28706 --- [main,,] .o.s.c.c.w.ConfigServerDataSourceWrapper : [config server datasource] username=root@ocp_meta 2024-12-31 18:14:25.841 INFO 28706 --- [main,,] .o.s.c.c.w.ConfigServerDataSourceWrapper : [config server datasource] jdbc url=jdbc:oceanbase://10.79.169.37:2881/meta_database?useUnicode=true&characterEncoding=UTF8&encloseParamInParentheses=false&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull 2024-12-31 18:14:25.876 INFO 28706 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : begin AfterDataSourceCreationHook 2024-12-31 18:14:25.876 INFO 28706 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : end AfterDataSourceCreationHook 2024-12-31 18:14:26.750 INFO 28706 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2024-12-31 18:14:29.581 INFO 28706 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2024-12-31 18:14:30.000 INFO 28706 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2024-12-31 18:14:30.001 INFO 28706 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2024-12-31 18:14:47.350 INFO 28706 --- [main,,] org.reflections.Reflections : Reflections took 7222 ms to scan 81 urls, producing 1062 keys and 7488 values 2024-12-31 18:14:55.201 INFO 28706 --- [main,,] org.reflections.Reflections : Reflections took 7755 ms to scan 81 urls, producing 1062 keys and 7488 values 2024-12-31 18:15:01.891 INFO 28706 --- [main,,] org.reflections.Reflections : Reflections took 6669 ms to scan 81 urls, producing 985 keys and 4895 values 2024-12-31 18:15:01.919 INFO 28706 --- [main,,] c.o.o.s.c.analyzer.OcpStartUpChecker : audit event is disable 2024-12-31 18:15:08.580 INFO 28706 --- [main,,] org.reflections.Reflections : Reflections took 6134 ms to scan 81 urls, producing 985 keys and 4895 values 2024-12-31 18:15:08.604 INFO 28706 --- [main,,] c.o.o.c.d.event.DistributedEventManager : [OCP116021] DistributedEventManager scanned event classes: [class com.oceanbase.ocp.core.mc.cache.RefreshOcpClusterCacheEvent, class com.oceanbase.ocp.core.distributed.event.NoContentDistributedEvent, class com.oceanbase.ocp.core.distributed.event.SimpleDistributedEvent, class com.oceanbase.ocp.core.configurl.event.RefreshClusterCacheEvent, class com.oceanbase.ocp.core.distributed.event.KeyValueDistributedEvent, class com.oceanbase.ocp.obops.cluster.event.InvalidateObVersionEvent, class com.oceanbase.ocp.service.obproxy.event.ResetAllProxyIdEvent, class com.oceanbase.ocp.obops.event.TenantRenamedDistributedEvent] 2024-12-31 18:15:08.606 INFO 28706 --- [main,,] c.o.o.c.d.event.DistributedEventManager : [OCP116025] DistributedEventManager construct event class class com.oceanbase.ocp.core.distributed.event.NoContentDistributedEvent failed, error: null 2024-12-31 18:15:08.606 INFO 28706 --- [main,,] c.o.o.c.d.event.DistributedEventManager : [OCP116025] DistributedEventManager construct event class class com.oceanbase.ocp.core.distributed.event.SimpleDistributedEvent failed, error: null 2024-12-31 18:15:08.606 INFO 28706 --- [main,,] c.o.o.c.d.event.DistributedEventManager : [OCP116025] DistributedEventManager construct event class class com.oceanbase.ocp.core.distributed.event.KeyValueDistributedEvent failed, error: null 2024-12-31 18:15:08.607 INFO 28706 --- [main,,] c.o.o.c.d.event.DistributedEventManager : [OCP116022] DistributedEventManager scanned event class map: {refresh ocp cluster cache=class com.oceanbase.ocp.core.mc.cache.RefreshOcpClusterCacheEvent, reset-all-obproxy-id=class com.oceanbase.ocp.service.obproxy.event.ResetAllProxyIdEvent, refresh-config-server-cache=class com.oceanbase.ocp.core.configurl.event.RefreshClusterCacheEvent, tenant-renamed=class com.oceanbase.ocp.obops.event.TenantRenamedDistributedEvent, invalidate-ob-version-cache=class com.oceanbase.ocp.obops.cluster.event.InvalidateObVersionEvent} 2024-12-31 18:15:08.636 INFO 28706 --- [main,,] c.o.o.c.d.event.DistributedEventManager : [OCP116001] DistributedEventManager started on a9efd8d51e 2024-12-31 18:15:08.879 INFO 28706 --- [main,,] com.oceanbase.ocp.core.util.BeanUtils : BeanUtils initialized 2024-12-31 18:15:11.857 INFO 28706 --- [main,,] c.o.o.a.c.AlarmConfigurationManager : defaultTimeZone not set, use system default, zoneId=Asia/Shanghai 2024-12-31 18:15:12.920 INFO 28706 --- [main,,] c.o.ocp.alarm.AlarmBeanConfiguration : scheduleEnabled=true 2024-12-31 18:15:13.187 INFO 28706 --- [main,,] c.o.o.a.service.TaskRepositoryService : create task success, task=TaskInfo(id=1, uuid=05b0ee56-3bf6-4d1d-a3be-d1fe245934fa, taskType=AlarmProcess, target=null, parameters=null, intervalSeconds=10, status=WAITING, executorName=10.79.169.37:28706, createAt=null, startAt=null, endAt=null, heartbeatAt=null, result=null) 2024-12-31 18:15:13.187 INFO 28706 --- [main,,] c.o.o.a.s.OcpAlarmInitializeService : create task done, taskType=AlarmProcess, expectCount=1, createCount=1 2024-12-31 18:15:13.187 INFO 28706 --- [main,,] c.o.o.a.s.OcpAlarmInitializeService : initialize global tasks done 2024-12-31 18:15:13.187 INFO 28706 --- [main,,] c.o.o.a.s.OcpAlarmInitializeService : initialize done 2024-12-31 18:15:14.393 INFO 28706 --- [main,,] c.o.o.alarm.core.silence.GlobalSilencer : enabled alarm types changed, previous=, current=ob_log_clog_write_error,ob_log_right_to_die,ob_host_net_send_percent_over_threshold,binlog_host_storage_usage_over_threshold,oblb_etcd_leader_absent,ob_tenant_compaction_error,ob_log_easy_hold_timeout,odp_instance_expanse_failed,binlog_host_cpu_usage_over_threshold,ob_log_decent_voting,ob_cluster_frozen_version_delta_over_threshold,binlog_node_status_abnormal,ob_log_commit_error,obproxy_memory_peak,host_operation,ob_log_mysql_request_full,ob_log_timer_cost_much,ob_log_worker_thread_full,host_disk_readonly,node_file_root_usage,rootservice_log_alarm,ob_log_disk_almost_full,obdns_etcd_cannot_connect_to_leader,oms_sync_failed,binlog_service_conversion_delay,ob_cluster_sync_delay_time_too_long,arbitration_service_unavailable,ob_cluster_merge_timeout,ob_common_unexpected_internal_error,partition_create_failed,ob_cluster_recyclebin_disk_used_over_threshold,ob_log_mem_alloc_error,ob_rootservice_stop_fail,base_backup_timeout,refresh_location_cache_failed,host_ntp_offset_too_large,ob_log_error_lib_direct_alloc,ob_host_invalid_disk_exists,ob_cluster_no_frozen,ocp_collect_metric_failure_rate_high,ob_log_distributed_strong_read,ob_tenant_cpu_usage_over_threshold,ob_log_fail_check_localserver,host_agent_open_fd_count_over_threshold,ob_cluster_sync_failed,oblb_ip_forward_invalid,backup_process_dead,oblb_keepalived_service_inactive,oblb_process_dead,ob_tenant500_storage_short_meta_mem_hold_high,ob_host_install_disk_percent_over_threshold,ob_tenant500_mem_hold_percent_over_threshold,odp_sql_execute_failed,binlog_instance_operation_info,obagent_dead,ob_server_stop_fail,ob_server_cannot_connect_arbitration,ob_log_rpc_error,ob_server_sstable_percent_over_threshold,oms_sync_delay,ob_host_monitordb_disconnected,oblb_keepalived_become_master,os_tsar_traffic_drop,ob_log_unit_migrate_error,ob_log_reply_memstore_failed,host_agent_version_not_same,ob_log_global_trans_version_delay,ob_tenant_partition_leader_absent,ob_cluster_operation_info,ob_cluster_merge_error,ob_tenant_name_mismatch,backup 2024-12-31 18:15:15.693 INFO 28706 --- [main,,] c.o.o.monitor.MonitorBeanConfiguration : Table name=metric_data_daily, createTime=1735640001 2024-12-31 18:15:15.693 INFO 28706 --- [main,,] c.o.o.monitor.MonitorBeanConfiguration : Set table switch time, time=1735640001 2024-12-31 18:15:16.960 INFO 28706 --- [main,,] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2024-12-31 18:15:17.289 INFO 28706 --- [main,,] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2024-12-31 18:15:17.440 INFO 28706 --- [main,,] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2024-12-31 18:15:17.603 INFO 28706 --- [main,,] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2024-12-31 18:15:17.758 INFO 28706 --- [main,,] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2024-12-31 18:15:18.050 INFO 28706 --- [main,,] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2024-12-31 18:15:18.059 INFO 28706 --- [main,,] c.o.o.m.query.LocalMetricQueryService : Monitor router init, username=system, connectTimeoutMs=3000, readTimeoutMs=120000 2024-12-31 18:15:18.588 INFO 28706 --- [heartbeat-alarm-detect-by-target-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Init consumer, consumerInfo=ShardingConsumerEntity(id=1, module=alarm-detect-by-target, name=10.79.169.37:8090, state=NEW, enabled=true, heartbeatTime=2024-12-31T18:15:18.576+08:00, createTime=null) 2024-12-31 18:15:18.589 INFO 28706 --- [heartbeat-alarm-detect-by-rule-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Init consumer, consumerInfo=ShardingConsumerEntity(id=2, module=alarm-detect-by-rule, name=10.79.169.37:8090, state=NEW, enabled=true, heartbeatTime=2024-12-31T18:15:18.576+08:00, createTime=null) 2024-12-31 18:15:19.329 INFO 28706 --- [tag-manual-task-1,,] c.o.ocp.service.task.TaskTagService : Tag task instances start. 2024-12-31 18:15:19.389 INFO 28706 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.print.sql = true 2024-12-31 18:15:19.389 INFO 28706 --- [main,,] c.o.ocp.obsdk.config.Configurations : [obsdk] set sqlLogEnabled=true 2024-12-31 18:15:19.391 INFO 28706 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.max-idle.seconds = 3600 2024-12-31 18:15:19.405 INFO 28706 --- [main,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] set maxIdleSeconds=3600 2024-12-31 18:15:19.409 INFO 28706 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.cleanup.period.seconds = 300 2024-12-31 18:15:19.409 INFO 28706 --- [main,,] c.o.ocp.obsdk.config.Configurations : [obsdk] set cleanPeriod=300 2024-12-31 18:15:19.411 INFO 28706 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.query.global.timeout.millis = 10000 2024-12-31 18:15:19.411 INFO 28706 --- [main,,] c.o.ocp.obsdk.config.Configurations : [obsdk] set queryGlobalTimeoutMillis=10000 2024-12-31 18:15:19.414 INFO 28706 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.operation.global.timeout.millis = 300000 2024-12-31 18:15:19.414 INFO 28706 --- [main,,] c.o.ocp.obsdk.config.Configurations : [obsdk] set ddlGlobalTimeoutMillis=300000 2024-12-31 18:15:19.416 INFO 28706 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.init.timeout.millis = 10000 2024-12-31 18:15:19.416 INFO 28706 --- [main,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] set initTimeoutMillis=10000 2024-12-31 18:15:19.418 INFO 28706 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.slow.query.threshold.millis = 1000 2024-12-31 18:15:19.418 INFO 28706 --- [main,,] c.o.ocp.obsdk.config.Configurations : [obsdk] set slowQueryThresholdMillis=1000 2024-12-31 18:15:19.420 INFO 28706 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.holder.capacity = 2000 2024-12-31 18:15:19.423 INFO 28706 --- [main,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] set cacheSize=2000 2024-12-31 18:15:19.426 INFO 28706 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.socket.read.timeout.millis = 1800000 2024-12-31 18:15:19.426 INFO 28706 --- [main,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] set socketReadTimeoutMillis=1800000 2024-12-31 18:15:19.428 INFO 28706 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.init.executor.thread-count = 16 2024-12-31 18:15:19.428 INFO 28706 --- [main,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] set socketInitThreadCount=16 2024-12-31 18:15:19.430 INFO 28706 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.socket.connect.timeout.millis = 2000 2024-12-31 18:15:19.430 INFO 28706 --- [main,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] set socketConnectTimeoutMillis=2000 2024-12-31 18:15:19.563 INFO 28706 --- [tag-manual-task-1,,] c.o.ocp.service.task.TaskTagService : Tag task instances end. 2024-12-31 18:15:23.402 INFO 28706 --- [main,,] c.o.o.s.o.operator.LocalFileOperator : FileStorageService init, fileDirPath=/data2/ocp-home 2024-12-31 18:15:23.606 INFO 28706 --- [sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Start rebalance, consumerSize=1, sliceEntitySize=0, strategy=com.oceanbase.ocp.alarm.sharding.AlarmDetectByRuleShardingStrategy@239ce432 2024-12-31 18:15:23.606 INFO 28706 --- [sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Start rebalance, consumerSize=1, sliceEntitySize=0, strategy=com.oceanbase.ocp.alarm.sharding.AlarmDetectByTargetIdShardingStrategy@4b0aa22e 2024-12-31 18:15:23.611 INFO 28706 --- [sharding-alarm-detect-by-target1,,] c.o.o.c.sharding.registry.ShardingTask : Mark consumer state, newState=PAUSE 2024-12-31 18:15:23.611 INFO 28706 --- [sharding-alarm-detect-by-rule1,,] c.o.o.c.sharding.registry.ShardingTask : Mark consumer state, newState=PAUSE 2024-12-31 18:15:24.659 INFO 28706 --- [heartbeat-alarm-detect-by-rule-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2024-12-31 18:15:24.659 INFO 28706 --- [heartbeat-alarm-detect-by-target-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2024-12-31 18:15:25.068 INFO 28706 --- [main,,] c.o.o.s.common.config.BeanConfiguration : begin set auto discover false. 2024-12-31 18:15:25.072 INFO 28706 --- [main,,] c.o.o.s.common.config.BeanConfiguration : set auto discover false success. 2024-12-31 18:15:25.177 INFO 28706 --- [sharding-alarm-detect-by-target1,,] c.o.o.c.sharding.registry.ShardingTask : Mark consumer state, newState=ASSIGNED 2024-12-31 18:15:25.243 INFO 28706 --- [sharding-alarm-detect-by-rule1,,] c.o.o.c.sharding.registry.ShardingTask : Mark consumer state, newState=ASSIGNED 2024-12-31 18:15:27.670 INFO 28706 --- [heartbeat-alarm-detect-by-rule-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2024-12-31 18:15:27.670 INFO 28706 --- [heartbeat-alarm-detect-by-target-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2024-12-31 18:15:27.671 INFO 28706 --- [heartbeat-alarm-detect-by-rule-10.79.169.37:80901,,] c.o.o.alarm.AlarmShardingConfiguration : Consumer had rebalanced. 2024-12-31 18:15:27.671 INFO 28706 --- [heartbeat-alarm-detect-by-target-10.79.169.37:80901,,] c.o.o.alarm.AlarmShardingConfiguration : Consumer had rebalanced. 2024-12-31 18:15:27.681 INFO 28706 --- [heartbeat-alarm-detect-by-rule-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Slice modified, module=alarm-detect-by-rule, name=10.79.169.37:8090, consumerId=2, resources=[ShardingSlice(consumerId=2, type=DEFAULT, resourceIds=[18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 80, 81, 106, 107, 249, 250, 251, 252, 253])] 2024-12-31 18:15:30.717 INFO 28706 --- [main,,] c.o.o.alarm.schedule.AlarmScheduledJobs : AlarmSchedules construct done 2024-12-31 18:15:31.780 INFO 28706 --- [main,,] c.o.o.a.c.d.MessageDistributorFactory : build alarmSubscribedJudger, currentSubscribedJudgerVersion subscription-0-2024-12-31T18:15:30.799+08:00_groups-11-2024-12-31T18:12:40+08:00-2024-12-31T18:12:40+08:00_detectRules-536-2024-12-31T10:12:44.838876Z_readableClusters_2_system- admin-, subscribedJudgerVersion 2024-12-31 18:15:31.789 INFO 28706 --- [main,,] c.o.o.a.c.distribute.DistributeBuilder : buildSubscribedJudger, usersSubscribedCount=0, userEnableReceiveCount=0 2024-12-31 18:15:31.789 INFO 28706 --- [main,,] c.o.o.a.c.d.MessageDistributorFactory : build recoverSubscribedJudger, currentSubscribedJudgerVersion subscription-0-2024-12-31T18:15:30.799+08:00_groups-11-2024-12-31T18:12:40+08:00-2024-12-31T18:12:40+08:00_detectRules-536-2024-12-31T10:12:44.838876Z_readableClusters_2_system- admin-, subscribedJudgerVersion 2024-12-31 18:15:31.790 INFO 28706 --- [main,,] c.o.o.a.c.distribute.DistributeBuilder : buildRecoverMessageSubscribedJudger, usersSubscribedCount=0, userEnableReceiveCount=0 2024-12-31 18:15:31.791 INFO 28706 --- [main,,] c.o.o.a.c.d.MessageDistributorFactory : buildAllDistributors 2024-12-31 18:15:31.868 INFO 28706 --- [main,,] c.o.o.a.c.n.NotificationSender : NotificationSender init, scriptDirectoryPath=/home/admin/ocp-server/alarm 2024-12-31 18:15:32.123 INFO 28706 --- [main,,] c.o.ocp.alarm.AlarmBeanConfiguration : initialize alarmTaskExecutor 2024-12-31 18:15:32.180 INFO 28706 --- [main,,] c.o.o.alarm.utils.task.AlarmTaskManager : alarm task manager construct done, executorName=10.79.169.37:28706 2024-12-31 18:15:32.287 INFO 28706 --- [main,,] c.o.o.a.c.d.metrics.AlarmMetricsQuery : createMetricMetaMapping done, metasCount=169 2024-12-31 18:15:32.342 INFO 28706 --- [main,,] c.o.o.a.c.d.metrics.SqlMetricsQuery : createMetricMetaMapping done, metasCount=169 2024-12-31 18:15:32.365 INFO 28706 --- [main,,] c.o.ocp.alarm.AlarmBeanConfiguration : initialize alarmDetectMetricExecutor 2024-12-31 18:15:32.428 INFO 28706 --- [main,,] c.o.ocp.alarm.core.task.AlarmDetectTask : AlarmDetectTask created 2024-12-31 18:15:32.738 INFO 28706 --- [main,,] c.o.o.c.d.s.DistributedServiceManager : DistributedService updater scheduler started on 10.79.169.37:8090 2024-12-31 18:15:32.747 INFO 28706 --- [main,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Init, apiConnectTimeoutMillis:1000, apiReadTimeoutMillis:1000, taskSchedulePeriodSec:3 2024-12-31 18:15:32.826 WARN 28706 --- [pool-11-thread-1,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service RATE_LIMIT, Incorrect result size: expected 1, actual 0 2024-12-31 18:15:32.826 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-12-31 18:15:34.685 INFO 28706 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_config_template.yaml in jar 2024-12-31 18:15:34.724 INFO 28706 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_ob_relations_config.yaml in jar 2024-12-31 18:15:34.747 INFO 28706 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_ability_ob_version_relation_config.yaml in jar 2024-12-31 18:15:34.756 INFO 28706 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from physical_backup_ability_ob_version_relation_config.yaml in jar 2024-12-31 18:15:35.827 WARN 28706 --- [pool-11-thread-1,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service RATE_LIMIT, Incorrect result size: expected 1, actual 0 2024-12-31 18:15:35.827 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-12-31 18:15:36.166 INFO 28706 --- [main,,] c.o.o.c.t.engine.util.ThreadPrintStream : replaceSystemOut done 2024-12-31 18:15:36.222 INFO 28706 --- [main,,] c.o.o.s.c.analyzer.SslTrustInitializer : ssl not enabled, do nothing 2024-12-31 18:15:37.669 INFO 28706 --- [main,,] c.o.o.s.c.c.s.u.SensitiveDataDecryptor : Validate and set keys, publicKey=null, valid=false 2024-12-31 18:15:37.754 WARN 28706 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2024-12-31 18:15:37.761 WARN 28706 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service MC_MANAGER, Incorrect result size: expected 1, actual 0 2024-12-31 18:15:37.767 WARN 28706 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PERF_SQL_ROLLUP, Incorrect result size: expected 1, actual 0 2024-12-31 18:15:37.772 WARN 28706 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service CMDB_SYNCER, Incorrect result size: expected 1, actual 0 2024-12-31 18:15:37.777 WARN 28706 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service TASK_MANAGER, Incorrect result size: expected 1, actual 0 2024-12-31 18:15:37.783 WARN 28706 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service RATE_LIMIT, Incorrect result size: expected 1, actual 0 2024-12-31 18:15:37.788 WARN 28706 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2024-12-31 18:15:37.793 WARN 28706 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2024-12-31 18:15:37.812 INFO 28706 --- [main,,] c.o.o.s.c.c.s.u.SensitiveDataDecryptor : Generate new rsa key, publicKey=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC4RG0d4r/p1eGjCZdy5fsVy1p2XSAATOFPv/XgcWlRRTb7Z+M+WxoSjwqNllEJuKXpoVnWdcDnjtR61lwMy+yS5mrxHN+vUh2ssZNuVXEQ3VXBn2AB6DbJp5xMcHYRbyAe5P866kCUaSRaoG1WTGbXRVOizbKwmkA1EYXDgj9sGwIDAQAB 2024-12-31 18:15:37.825 INFO 28706 --- [main,,] c.o.ocp.core.property.PropertyService : Inner update property, key=ocp.sensitive-data.encryption.public-key, previousValue=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC4RG0d4r/p1eGjCZdy5fsVy1p2XSAATOFPv/XgcWlRRTb7Z+M+WxoSjwqNllEJuKXpoVnWdcDnjtR61lwMy+yS5mrxHN+vUh2ssZNuVXEQ3VXBn2AB6DbJp5xMcHYRbyAe5P866kCUaSRaoG1WTGbXRVOizbKwmkA1EYXDgj9sGwIDAQAB, updatedValue=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC4RG0d4r/p1eGjCZdy5fsVy1p2XSAATOFPv/XgcWlRRTb7Z+M+WxoSjwqNllEJuKXpoVnWdcDnjtR61lwMy+yS5mrxHN+vUh2ssZNuVXEQ3VXBn2AB6DbJp5xMcHYRbyAe5P866kCUaSRaoG1WTGbXRVOizbKwmkA1EYXDgj9sGwIDAQAB, runningValue= 2024-12-31 18:15:37.835 INFO 28706 --- [main,,] c.o.ocp.core.property.PropertyService : Inner update property, key=ocp.sensitive-data.encryption.private-key, previousValue=MIICdQIBADANBgkqhkiG9w0BAQEFAASCAl8wggJbAgEAAoGBALhEbR3iv+nV4aMJl3Ll+xXLWnZdIABM4U+/9eBxaVFFNvtn4z5bGhKPCo2WUQm4pemhWdZ1wOeO1HrWXAzL7JLmavEc369SHayxk25VcRDdVcGfYAHoNsmnnExwdhFvIB7k/zrqQJRpJFqgbVZMZtdFU6LNsrCaQDURhcOCP2wbAgMBAAECgYAM3QH9Bxo8maixt/axl6pqgBKllqSoQLWt2omwjFo8yScob70mWje8ue2Tqr2nfxNd9tyNoxS/VXIxzQsJ/aZbEGyy+E/Hyq0c65GpolrFn5x6VagzKZdbLgt+mRDS3ycohTlualszU27CZtbKaOvPmEZPFP7SEroOQyyLVTTTCQJBAPC7B2FRUm0w8UvqzNYWrm2nDrvPLjP6ekUNl+FlvI564lbPVBAJ8GMlvExLt0LV2p+m+XkS7ZJMFX5WXJK9FcUCQQDD9Iye66LeuAs1ZEv+zHsJG99d2zP15jTIhyvTh9uQy04asjAqwYrAb6jQn5Cd5OR4IaVlhz/Ib56VNd1aYHhfAkAewmchAjkcBqLuZmQh/ufuzufNC54Fuj2hUSlU/aDoO79sBDXjjsGOiaXTweD6w0SaHcXGuKpuhRZB/Fr7zPlZAkBvCI/xsNVd2+1F+KnzG8yPkcKUfRPJPwMjqSwVNUMdnYWJLPSMFZTYi6ydYfzg6wTmaTI+AFAM8+po49ekUUuDAkAaUQJZSoekI6cQU8ct3EoXUucrX+9M6AWPBhBBbV6Tv+yUD3xE0/eeZtCJmOySeomTHN/Ro0b4Zy2wS+9oscAr, updatedValue=MIICdQIBADANBgkqhkiG9w0BAQEFAASCAl8wggJbAgEAAoGBALhEbR3iv+nV4aMJl3Ll+xXLWnZdIABM4U+/9eBxaVFFNvtn4z5bGhKPCo2WUQm4pemhWdZ1wOeO1HrWXAzL7JLmavEc369SHayxk25VcRDdVcGfYAHoNsmnnExwdhFvIB7k/zrqQJRpJFqgbVZMZtdFU6LNsrCaQDURhcOCP2wbAgMBAAECgYAM3QH9Bxo8maixt/axl6pqgBKllqSoQLWt2omwjFo8yScob70mWje8ue2Tqr2nfxNd9tyNoxS/VXIxzQsJ/aZbEGyy+E/Hyq0c65GpolrFn5x6VagzKZdbLgt+mRDS3ycohTlualszU27CZtbKaOvPmEZPFP7SEroOQyyLVTTTCQJBAPC7B2FRUm0w8UvqzNYWrm2nDrvPLjP6ekUNl+FlvI564lbPVBAJ8GMlvExLt0LV2p+m+XkS7ZJMFX5WXJK9FcUCQQDD9Iye66LeuAs1ZEv+zHsJG99d2zP15jTIhyvTh9uQy04asjAqwYrAb6jQn5Cd5OR4IaVlhz/Ib56VNd1aYHhfAkAewmchAjkcBqLuZmQh/ufuzufNC54Fuj2hUSlU/aDoO79sBDXjjsGOiaXTweD6w0SaHcXGuKpuhRZB/Fr7zPlZAkBvCI/xsNVd2+1F+KnzG8yPkcKUfRPJPwMjqSwVNUMdnYWJLPSMFZTYi6ydYfzg6wTmaTI+AFAM8+po49ekUUuDAkAaUQJZSoekI6cQU8ct3EoXUucrX+9M6AWPBhBBbV6Tv+yUD3xE0/eeZtCJmOySeomTHN/Ro0b4Zy2wS+9oscAr, runningValue= 2024-12-31 18:15:37.835 INFO 28706 --- [main,,] c.o.o.s.c.c.s.u.SensitiveDataDecryptor : Refresh and set keys, publicKey=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC4RG0d4r/p1eGjCZdy5fsVy1p2XSAATOFPv/XgcWlRRTb7Z+M+WxoSjwqNllEJuKXpoVnWdcDnjtR61lwMy+yS5mrxHN+vUh2ssZNuVXEQ3VXBn2AB6DbJp5xMcHYRbyAe5P866kCUaSRaoG1WTGbXRVOizbKwmkA1EYXDgj9sGwIDAQAB 2024-12-31 18:15:37.926 INFO 28706 --- [main,,] c.o.o.a.c.AlarmConfiguration : alarm configuration set from system properties 2024-12-31 18:15:38.828 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 gets the leadership... 2024-12-31 18:15:39.173 INFO 28706 --- [main,,] c.o.o.m.promethues.InnerMetricContainer : init inner metric container success, configToMetricMap = {InnerMetricContainer.InnerMetricConfig(scrapeType=second)=[system_cpu_count, jvm_threads_states_threads, jvm_gc_memory_promoted_bytes_total, jvm_memory_committed_bytes, ocp_monitor_collect_request_errors_total, ocp_meta_db_health, jvm_gc_pause_seconds_max, ocp_monitor_collect_request_duration_ms_count, system_cpu_usage, process_threads, http_server_requests_seconds_count, jvm_gc_memory_allocated_bytes_total, jvm_threads_peak_threads, ocp_alarm_detect_duration_ms_count, jvm_memory_used_bytes, process_cpu_usage, jvm_memory_max_bytes, jvm_gc_max_data_size_bytes, http_server_requests_seconds_sum, jvm_gc_pause_seconds_sum, ocp_alarm_detect_duration_ms_sum, jvm_threads_live_threads, system_load_average_1m, jvm_gc_pause_seconds_count, jvm_gc_overhead_percent]} 2024-12-31 18:15:39.284 INFO 28706 --- [main,,] c.o.o.s.c.config.MetricConfiguration : Monitor sharding strategy is monitor 2024-12-31 18:15:40.037 INFO 28706 --- [main,,] .o.o.o.i.c.ClusterSystemEventServiceImpl : Init eventTemplateCache: 172 cache entries, 172 elements. 2024-12-31 18:15:41.202 INFO 28706 --- [main,,] c.o.o.s.c.BuiltInFilesInitializeLoader : Load lib files, localBuiltInDir=/data2/ocp-home/ocp/ocp-server/lib 2024-12-31 18:15:41.202 INFO 28706 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : Remove built-in file:obproxyd.sh 2024-12-31 18:15:41.255 ERROR 28706 --- [main,,] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.IllegalArgumentException occurred with code error.file.meta.not.found, and args [built-in, obproxyd.sh] 2024-12-31 18:15:41.255 INFO 28706 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : Script:obproxyd.sh not exist. 2024-12-31 18:15:41.255 INFO 28706 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : Load built-in file:obproxyd.sh 2024-12-31 18:15:41.392 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Init saving object, creatorId=200, bucket=built-in, name=obproxyd.sh, objectId=1 2024-12-31 18:15:41.598 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Finish saving object, objectId=1, name=obproxyd.sh 2024-12-31 18:15:41.636 INFO 28706 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : packageName:ocp-agent-ce-4.3.2-20241012145836.el7.aarch64.rpm 2024-12-31 18:15:41.760 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Init saving object, creatorId=200, bucket=sys-package, name=ocp-agent-ce-4.3.2-20241012145836.el7.aarch64.rpm, objectId=2 2024-12-31 18:15:41.828 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:15:41.899 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:15:44.339 INFO 28706 --- [heartbeat-metric-collect-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Init consumer, consumerInfo=ShardingConsumerEntity(id=3, module=metric-collect, name=10.79.169.37:8090, state=NEW, enabled=true, heartbeatTime=2024-12-31T18:15:44.310+08:00, createTime=null) 2024-12-31 18:15:44.370 INFO 28706 --- [sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Start rebalance, consumerSize=1, sliceEntitySize=0, strategy=com.oceanbase.ocp.monitor.sharding.MonitorShardingStrategy@4294bf53 2024-12-31 18:15:44.372 INFO 28706 --- [sharding-metric-collect1,,] c.o.o.c.sharding.registry.ShardingTask : Mark consumer state, newState=PAUSE 2024-12-31 18:15:44.900 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:15:44.902 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:15:45.137 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Finish saving object, objectId=2, name=ocp-agent-ce-4.3.2-20241012145836.el7.aarch64.rpm 2024-12-31 18:15:45.151 INFO 28706 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : packageName:ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm 2024-12-31 18:15:45.179 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Init saving object, creatorId=200, bucket=sys-package, name=ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm, objectId=3 2024-12-31 18:15:47.343 INFO 28706 --- [heartbeat-metric-collect-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2024-12-31 18:15:47.545 INFO 28706 --- [sharding-metric-collect1,,] c.o.o.c.sharding.registry.ShardingTask : Mark consumer state, newState=ASSIGNED 2024-12-31 18:15:47.902 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:15:47.904 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:15:50.423 INFO 28706 --- [heartbeat-metric-collect-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2024-12-31 18:15:50.423 INFO 28706 --- [heartbeat-metric-collect-10.79.169.37:80901,,] c.o.o.s.c.config.MetricConfiguration : Consumer had rebalanced. 2024-12-31 18:15:50.905 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:15:50.907 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:15:50.931 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Finish saving object, objectId=3, name=ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm 2024-12-31 18:15:50.936 INFO 28706 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : packageName:oceanbase-ce-utils-4.2.1.10-110000072024112010.el7.x86_64.rpm 2024-12-31 18:15:50.967 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Init saving object, creatorId=200, bucket=sys-package, name=oceanbase-ce-utils-4.2.1.10-110000072024112010.el7.x86_64.rpm, objectId=4 2024-12-31 18:15:53.907 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:15:53.909 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:15:56.910 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:15:56.912 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:15:59.913 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:15:59.915 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:02.333 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Finish saving object, objectId=4, name=oceanbase-ce-utils-4.2.1.10-110000072024112010.el7.x86_64.rpm 2024-12-31 18:16:02.338 INFO 28706 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : packageName:oceanbase-ce-4.2.1.10-110000072024112010.el7.x86_64.rpm 2024-12-31 18:16:02.367 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Init saving object, creatorId=200, bucket=sys-package, name=oceanbase-ce-4.2.1.10-110000072024112010.el7.x86_64.rpm, objectId=5 2024-12-31 18:16:02.915 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:02.917 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:05.917 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:05.920 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:08.920 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:08.922 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:11.923 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:11.927 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:14.785 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Finish saving object, objectId=5, name=oceanbase-ce-4.2.1.10-110000072024112010.el7.x86_64.rpm 2024-12-31 18:16:14.790 INFO 28706 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : packageName:oceanbase-ce-libs-4.2.1.10-110000072024112010.el7.x86_64.rpm 2024-12-31 18:16:14.871 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Init saving object, creatorId=200, bucket=sys-package, name=oceanbase-ce-libs-4.2.1.10-110000072024112010.el7.x86_64.rpm, objectId=6 2024-12-31 18:16:14.911 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Finish saving object, objectId=6, name=oceanbase-ce-libs-4.2.1.10-110000072024112010.el7.x86_64.rpm 2024-12-31 18:16:14.915 INFO 28706 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : packageName:obproxy-ce-4.3.2.0-26.el7.x86_64.rpm 2024-12-31 18:16:14.927 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:14.929 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:14.937 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Init saving object, creatorId=200, bucket=sys-package, name=obproxy-ce-4.3.2.0-26.el7.x86_64.rpm, objectId=7 2024-12-31 18:16:17.929 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:17.932 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:20.932 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:20.935 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:23.935 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:23.938 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:26.938 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:26.940 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:29.941 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:29.943 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:32.943 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:32.945 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:35.946 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:35.948 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:38.948 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:38.950 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:41.951 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:41.953 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:44.953 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:44.956 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:47.956 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:47.959 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:50.959 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:50.961 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:53.962 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:53.963 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:56.239 INFO 28706 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Finish saving object, objectId=7, name=obproxy-ce-4.3.2.0-26.el7.x86_64.rpm 2024-12-31 18:16:56.251 INFO 28706 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : Save matched ocp-agent version, version=4.3.2-20241012145836 2024-12-31 18:16:56.302 INFO 28706 --- [main,,] c.o.ocp.core.property.PropertyService : Inner update property, key=ocp.agent.version.full, previousValue=4.3.2-20241012145836, updatedValue=4.3.2-20241012145836, runningValue= 2024-12-31 18:16:56.533 INFO 28706 --- [main,,] c.o.o.s.dataclean.TableCleaningService : Successfully init all table cleaning configurations: {"cleanDistributedEvent":{"batchIntervalMillis":0,"batchSize":0,"condition":"expire_time <= date_sub(curdate(), interval 30 day)","priority":1,"tableName":"distributed_event"},"cleanDistributedEventReception":{"batchIntervalMillis":0,"batchSize":0,"condition":"event_id in (select id from distributed_event where expire_time <= date_sub(curdate(), interval 30 day))","priority":0,"tableName":"distributed_event_reception"},"cleanStatusTransition":{"batchIntervalMillis":0,"batchSize":0,"condition":"expire_time <= date_sub(curdate(), interval 30 day)","priority":0,"tableName":"ops_status_transition"}} 2024-12-31 18:16:56.964 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:56.966 INFO 28706 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:16:57.119 INFO 28706 --- [main,,] f.a.AutowiredAnnotationBeanPostProcessor : Autowired annotation is not supported on static methods: public static void com.oceanbase.ocp.core.util.jpa.JsonNodeConverter.init(com.fasterxml.jackson.databind.ObjectMapper) 2024-12-31 18:16:57.404 INFO 28706 --- [main,,] s.i.c.SqlAuditRawStatRollupDaemonService : SQL stat rollup daemon submitted 2024-12-31 18:16:57.407 INFO 28706 --- [main,,] s.i.c.SqlAuditRawStatRollupDaemonService : SQL stat rollup workers submitted 2024-12-31 18:16:59.341 INFO 28706 --- [main,,] c.o.ocp.ha.maz.OcpAzoneDaemonService : Multi azone daemon not enabled 2024-12-31 18:16:59.427 INFO 28706 --- [main,,] c.o.ocp.monitor.OcpMonitorManager : OcpMonitorManager init start... 2024-12-31 18:16:59.429 INFO 28706 --- [main,,] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640220, interval=60 2024-12-31 18:16:59.429 INFO 28706 --- [main,,] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:16:59.431 INFO 28706 --- [main,,] c.o.ocp.monitor.OcpMonitorManager : OcpMonitorManager init success. 2024-12-31 18:16:59.525 INFO 28706 --- [main,,] c.o.o.m.c.MonitorDataRolloverProperties : Monitor retention conf is {ob_cluster_system_event=31, ob_cluster_server_event=31, ocp_metric_data_1=8, ocp_metric_data_60=31, metric_data_async=1, metric_hour_data=1098, metric_daily_data=1098} 2024-12-31 18:16:59.791 INFO 28706 --- [main,,] .r.DefaultUserResourceManagerServiceImpl : not UPGRADE, skip create default user resource 2024-12-31 18:16:59.966 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:16:59.969 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:17:00.197 INFO 28706 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_config_template.yaml in jar 2024-12-31 18:17:00.206 INFO 28706 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_ob_relations_config.yaml in jar 2024-12-31 18:17:00.209 INFO 28706 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_ability_ob_version_relation_config.yaml in jar 2024-12-31 18:17:00.209 INFO 28706 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from physical_backup_ability_ob_version_relation_config.yaml in jar 2024-12-31 18:17:00.210 INFO 28706 --- [main,,] c.o.o.b.i.c.BackupConfiguration : init backup agent meta cfg 2024-12-31 18:17:00.224 INFO 28706 --- [main,,] c.o.o.c.t.e.m.TaskDefinitionManagerImpl : Create task, req=CreateTaskRequest(name=Clean expired log files on schedule, creatorId=200, groupId=2, scheduleType=SCHEDULE, scheduleRule=0 0 0 * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, templateName=BackupScheduleCleanLogTemplateFactory, comments=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}, enable=true) 2024-12-31 18:17:00.443 INFO 28706 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : Backup init, create system schedule task, task=TaskDefinition{id=1000000, name=Clean expired log files on schedule, creatorId=200, templateName=BackupScheduleCleanLogTemplateFactory, scheduleType=SCHEDULE, scheduleRule=0 0 0 * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, nextRunTime=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}}. 2024-12-31 18:17:00.450 INFO 28706 --- [main,,] c.o.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key global_lock_com.oceanbase.ocp.backup.internal.task.backupocptaskmanager 2024-12-31 18:17:00.456 INFO 28706 --- [main,,] c.o.o.b.i.a.BackupRestoreAgentService : upgradeFromOldAgentToNewService start. 2024-12-31 18:17:00.544 INFO 28706 --- [main,,] c.o.o.b.i.a.BackupRestoreAgentService : serviceInfos=[], allMachineList=[] 2024-12-31 18:17:00.548 INFO 28706 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : register backup schedules success 2024-12-31 18:17:01.044 INFO 28706 --- [main,,] c.o.ocp.alarm.AlarmBeanConfiguration : initialize notificationSendExecutor 2024-12-31 18:17:01.785 INFO 28706 --- [main,,] .s.c.c.s.c.OcpSecurityConfiguratorHelper : Configure session, policy=STATELESS. 2024-12-31 18:17:01.804 INFO 28706 --- [main,,] s.c.c.s.c.StatelessSecurityConfiguration : Internal auth configured. 2024-12-31 18:17:01.806 INFO 28706 --- [main,,] s.c.c.s.c.StatelessSecurityConfiguration : Access key auth configured. 2024-12-31 18:17:01.811 INFO 28706 --- [main,,] s.c.c.s.c.StatelessSecurityConfiguration : Basic auth enabled. 2024-12-31 18:17:02.273 INFO 28706 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will secure com.oceanbase.ocp.server.common.config.security.conf.StatelessSecurityConfiguration$$Lambda$2082/1201293791@6da8b9fe with [org.springframework.security.web.session.DisableEncodeUrlFilter@675f32ab, org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@4c77c019, org.springframework.security.web.context.SecurityContextPersistenceFilter@3aa8cf74, org.springframework.security.web.header.HeaderWriterFilter@7ebfb2fd, org.springframework.security.web.authentication.logout.LogoutFilter@4772c462, com.oceanbase.ocp.server.common.config.security.accesskey.ContentCacheRequestFilter@444796e9, com.oceanbase.ocp.server.common.config.security.filter.InternalAuthenticationFilter@6c08a0d6, com.oceanbase.ocp.server.common.config.security.accesskey.AccessKeyAuthenticationFilter@725c1d96, com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter@596ccc, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@5156ab44, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@79ba5dc7, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@56c53468, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@785142f0, org.springframework.security.web.session.SessionManagementFilter@67817beb, org.springframework.security.web.access.ExceptionTranslationFilter@1b72b95c, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@74e85edf] 2024-12-31 18:17:02.738 INFO 28706 --- [main,,] o.o.core.config.InitializationService : Initializing OpenSAML using the Java Services API 2024-12-31 18:17:02.970 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:17:02.972 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:17:02.977 INFO 28706 --- [main,,] o.o.xmlsec.algorithm.AlgorithmRegistry : Algorithm failed runtime support check, will not be usable: http://www.w3.org/2001/04/xmlenc#ripemd160 2024-12-31 18:17:02.985 INFO 28706 --- [main,,] o.o.xmlsec.algorithm.AlgorithmRegistry : Algorithm failed runtime support check, will not be usable: http://www.w3.org/2001/04/xmldsig-more#hmac-ripemd160 2024-12-31 18:17:03.002 INFO 28706 --- [main,,] o.o.xmlsec.algorithm.AlgorithmRegistry : Algorithm failed runtime support check, will not be usable: http://www.w3.org/2001/04/xmldsig-more#rsa-ripemd160 2024-12-31 18:17:04.484 INFO 28706 --- [main,,] .s.c.c.s.c.OcpSecurityConfiguratorHelper : Configure session, policy=IF_REQUIRED. 2024-12-31 18:17:04.486 INFO 28706 --- [main,,] .s.c.c.s.c.OcpSecurityConfiguratorHelper : CSRF configured. 2024-12-31 18:17:04.922 INFO 28706 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will secure any request with [org.springframework.security.web.session.DisableEncodeUrlFilter@7c6cfb59, org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@3b9eff20, org.springframework.security.web.context.SecurityContextPersistenceFilter@526b58b7, org.springframework.security.web.header.HeaderWriterFilter@478f267d, org.springframework.security.web.csrf.CsrfFilter@32711eee, org.springframework.security.web.authentication.logout.LogoutFilter@f80aaa9, org.springframework.security.oauth2.client.web.OAuth2AuthorizationRequestRedirectFilter@6e4ca991, org.springframework.security.saml2.provider.service.servlet.filter.Saml2WebSsoAuthenticationRequestFilter@66b0b85, com.oceanbase.ocp.server.common.config.security.filter.TestLoginAuthenticationFilter@6a6e88e6, org.springframework.security.oauth2.client.web.OAuth2LoginAuthenticationFilter@32796f1, org.springframework.security.saml2.provider.service.servlet.filter.Saml2WebSsoAuthenticationFilter@62af164, com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter@52cfb4a, com.oceanbase.ocp.server.common.config.security.filter.PreUsernamePasswordAuthenticationFilter@1e016e85, org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter@29cf4cd7, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@5ac4b4d3, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@64c6dd38, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@52aaf59a, org.springframework.security.web.session.SessionManagementFilter@7d33d60c, org.springframework.security.web.access.ExceptionTranslationFilter@4c2881e8, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@63c5452e] 2024-12-31 18:17:05.127 INFO 28706 --- [main,,] c.o.o.s.c.config.SpringScheduleConfig : Spring scheduled pool size is 30. 2024-12-31 18:17:05.158 INFO 28706 --- [main,,] c.o.o.b.i.m.s.StorageExporterServiceImpl : storage exporter register: collectEnable=true, periodMinutes=180 2024-12-31 18:17:05.158 INFO 28706 --- [main,,] c.o.o.b.i.m.s.StorageExporterServiceImpl : register backup exporter, periodMinutes=180 2024-12-31 18:17:05.161 INFO 28706 --- [main,,] c.o.o.c.t.e.m.TaskDefinitionManagerImpl : Create task, req=CreateTaskRequest(name=Collect backup files size on schedule, creatorId=200, groupId=2, scheduleType=SCHEDULE, scheduleRule=0 0 */3 * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, templateName=BackupScheduleCollectTemplateFactory, comments=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}, enable=true) 2024-12-31 18:17:05.170 INFO 28706 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : Backup init, create system schedule task, task=TaskDefinition{id=1000001, name=Collect backup files size on schedule, creatorId=200, templateName=BackupScheduleCollectTemplateFactory, scheduleType=SCHEDULE, scheduleRule=0 0 */3 * * *, scheduleStartTime=null, scheduleEndTime=null, scheduleDurationUnit=Days, nextRunTime=null, arguments=Argument{parallelIdx=-1, stringMap={}, listMap={}}}. 2024-12-31 18:17:05.647 INFO 28706 --- [main,,] c.o.o.s.o.s.c.OverviewBeanConfiguration : initialize overviewContainerExecutor 2024-12-31 18:17:05.972 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:17:05.975 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:17:06.091 WARN 28706 --- [main,,] JpaBaseConfiguration$JpaWebConfiguration : spring.jpa.open-in-view is enabled by default. Therefore, database queries may be performed during view rendering. Explicitly configure spring.jpa.open-in-view to disable this warning 2024-12-31 18:17:07.304 INFO 28706 --- [main,,] o.s.b.a.w.s.WelcomePageHandlerMapping : Adding welcome page: class path resource [static/index.html] 2024-12-31 18:17:08.975 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:17:08.978 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:17:10.709 INFO 28706 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-12-31 18:17:10.730 INFO 28706 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-12-31 18:17:11.878 WARN 28706 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/assets/**']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:17:11.878 INFO 28706 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/assets/**'] 2024-12-31 18:17:11.879 WARN 28706 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/index.html']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:17:11.879 INFO 28706 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/index.html'] 2024-12-31 18:17:11.879 WARN 28706 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/**/*.js']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:17:11.879 INFO 28706 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/**/*.js'] 2024-12-31 18:17:11.879 WARN 28706 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/**/*.css']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:17:11.879 INFO 28706 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/**/*.css'] 2024-12-31 18:17:11.879 WARN 28706 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/webjars/**']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:17:11.879 INFO 28706 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/webjars/**'] 2024-12-31 18:17:11.879 WARN 28706 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/**/*.svg']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:17:11.879 INFO 28706 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/**/*.svg'] 2024-12-31 18:17:11.879 WARN 28706 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/login']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:17:11.879 INFO 28706 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/login'] 2024-12-31 18:17:11.879 WARN 28706 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/docs/**']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:17:11.879 INFO 28706 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/docs/**'] 2024-12-31 18:17:11.879 WARN 28706 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/favicon.ico']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:17:11.879 INFO 28706 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/favicon.ico'] 2024-12-31 18:17:11.879 WARN 28706 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/pre_login_loading']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:17:11.879 INFO 28706 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/pre_login_loading'] 2024-12-31 18:17:11.979 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:17:11.982 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:17:12.684 INFO 28706 --- [main,,] o.s.b.a.e.web.EndpointLinksResolver : Exposing 2 endpoint(s) beneath base path '/actuator' 2024-12-31 18:17:13.007 INFO 28706 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat started on port(s): 8090 (http) with context path '' 2024-12-31 18:17:13.258 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Ocp scheduled task specified config name, methodName=collectHighRiskSqlAuditStat, configName=collectHighSqlAuditStat 2024-12-31 18:17:13.259 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=4 2024-12-31 18:17:13.259 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectHighRiskSqlAuditStat, conf=ScheduledConf{initialDelay=120, cron='null', fixedDelay=300, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.259 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=oasSqlCuring, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.259 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectSlowSqlForAlarm, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.259 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectTransStatForAlarm, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.259 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=2 2024-12-31 18:17:13.259 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=syncBinlogClusters, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=30, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.259 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=syncBinlogInstances, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=14 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=fixAlarmTarget, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=resolveAlarmsOfAbsentTargets, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshBackupAlarmStat, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=180, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshGlobalSilencer, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=10, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshActiveAlarmStatus, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshDetectorFactory, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=alarmDetectOnce, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=10, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshHostAlarmInfo, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=600, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=removeInactiveAlarmEvents, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=600, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshAlarmTaskManager, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=20, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshAlarmTargets, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshAlarmSummary, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshAggregators, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=10, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshAlarmInMemory, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.common.scheduled.OcpSchedules : Ocp multi cluster mode disabled. 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.common.scheduled.OcpSchedules : Ocp vpd mode disabled. 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=8 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=partitionDaemon, conf=ScheduledConf{initialDelay=120, cron='null', fixedDelay=600, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=cleanupDruidCache, conf=ScheduledConf{initialDelay=600, cron='null', fixedDelay=300, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=cleanTmpLogFiles, conf=ScheduledConf{initialDelay=0, cron='0 20 4 * * *', fixedDelay=0, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=cleanTaskRecords, conf=ScheduledConf{initialDelay=0, cron='0 20 5 * * *', fixedDelay=0, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkOdpClient, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectOdpMetrics, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshOcpConfig, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=180, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=cleanTaskLog, conf=ScheduledConf{initialDelay=0, cron='0 10 3 * * *', fixedDelay=0, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=7 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkHostAgentStatus, conf=ScheduledConf{initialDelay=120, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkHostStatus, conf=ScheduledConf{initialDelay=120, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkHostVersion, conf=ScheduledConf{initialDelay=30, cron='null', fixedDelay=4, fixedRate=0, timeUnit=MINUTES, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkCpuBindCore, conf=ScheduledConf{initialDelay=120, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshAgentConfig, conf=ScheduledConf{initialDelay=2, cron='null', fixedDelay=10, fixedRate=0, timeUnit=MINUTES, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=getHostAgentAlarms, conf=ScheduledConf{initialDelay=2, cron='null', fixedDelay=1, fixedRate=0, timeUnit=MINUTES, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkHostClockDiff, conf=ScheduledConf{initialDelay=120, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=2 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectObproxyMetrics, conf=ScheduledConf{initialDelay=120, cron='10/30 * * * * *', fixedDelay=0, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkObproxyServers, conf=ScheduledConf{initialDelay=120, cron='10/30 * * * * *', fixedDelay=0, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.260 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=8 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkClusterStatus, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkStandbyClusterInfo, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=syncClusterInfo, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=syncRootServer, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=120, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=syncClusterSystemEvent, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=600, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectAllClusterCompaction, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkAllArbitrationService, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkClusterRootServer, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=0, fixedRate=300, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=5 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=syncAllTenantInfo, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkAllStandbyTenant, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectAllTenantMajorCompaction, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectAllTenantMiniCompaction, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=300, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.261 INFO 28706 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkAllTenantServiceNameConflict, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:17:13.296 INFO 28706 --- [ocp-schedules-3,31e762d34f519564,2da1e7e496395187] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:17:13.297 INFO 28706 --- [ocp-schedules-16,e43b32c90109b4f0,cd67e91f4744e044] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:17:13.297 INFO 28706 --- [ocp-schedules-11,db984bb6fad2c63a,d26ce24625708254] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:17:13.299 INFO 28706 --- [ocp-schedules-21,b3ec17162b8a3642,443fa9515e790a89] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:17:13.301 INFO 28706 --- [ocp-schedules-14,8f4010c7d28c9f9f,9c7f3689c9e4d0cf] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:17:13.304 INFO 28706 --- [ocp-schedules-1,5c095e07a02f8d53,137e67be96bacb65] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:17:13.306 INFO 28706 --- [ocp-schedules-25,602447a7324b4863,4df37016d567b6e9] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper 2024-12-31 18:17:13.307 ERROR 28706 --- [ocp-schedules-14,8f4010c7d28c9f9f,9c7f3689c9e4d0cf] com.alibaba.druid.pool.DruidDataSource : testWhileIdle is true, validationQuery not set 2024-12-31 18:17:13.307 INFO 28706 --- [ocp-schedules-23,90745caa34e1d597,0cd4724fd0409460] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:17:13.312 INFO 28706 --- [ocp-schedules-23,90745caa34e1d597,0cd4724fd0409460] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:17:13.314 INFO 28706 --- [ocp-schedules-14,8f4010c7d28c9f9f,9c7f3689c9e4d0cf] com.alibaba.druid.pool.DruidDataSource : {dataSource-7} inited 2024-12-31 18:17:13.314 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ************************* ACTIVE OCP PROPERTIES ****************************** 2024-12-31 18:17:13.318 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : Active profiles: [composite] 2024-12-31 18:17:13.318 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2024-12-31 18:17:13.319 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.ocp.core.property.PropertyService : Refresh config properties 2024-12-31 18:17:13.319 INFO 28706 --- [ocp-schedules-5,098b7f20a0b1f14e,60685b95dde87654] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2024-12-31 18:17:13.319 INFO 28706 --- [ocp-schedules-8,5b2bd55e93df15a9,b820fdbd123b4308] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster system event. 2024-12-31 18:17:13.319 INFO 28706 --- [ocp-schedules-13,859409658736c508,1cfe9ea7fab42325] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:17:13.320 INFO 28706 --- [ocp-schedules-22,cf44e1391d8f03cb,613f516128886658] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:17:13.320 INFO 28706 --- [ocp-schedules-7,d9f0332f13788780,a72e58aed693894c] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:17:13.320 INFO 28706 --- [ocp-schedules-15,df3d484ffca84fc4,1088b1add7d7b87c] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant mini compaction 2024-12-31 18:17:13.323 INFO 28706 --- [ocp-schedules-28,1fbd760fac3a1240,334974bce1374aac] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:17:13.323 ERROR 28706 --- [ocp-schedules-11,db984bb6fad2c63a,d26ce24625708254] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task java.lang.RuntimeException: java.lang.reflect.InvocationTargetException at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:79) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) ... 10 common frames omitted Caused by: java.lang.NullPointerException: null at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.adaptTimeout(AbstractSchedules.java:47) at com.oceanbase.ocp.server.common.scheduled.ClusterSchedules.syncClusterInfo(ClusterSchedules.java:77) ... 15 common frames omitted 2024-12-31 18:17:13.323 INFO 28706 --- [ocp-schedules-7,d9f0332f13788780,a72e58aed693894c] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:17:13.323 INFO 28706 --- [ocp-schedules-15,df3d484ffca84fc4,1088b1add7d7b87c] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2024-12-31 18:17:13.323 INFO 28706 --- [ocp-schedules-28,1fbd760fac3a1240,334974bce1374aac] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:17:13.325 ERROR 28706 --- [ocp-schedules-22,cf44e1391d8f03cb,613f516128886658] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task java.lang.RuntimeException: java.lang.reflect.InvocationTargetException at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:79) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) ... 10 common frames omitted Caused by: java.lang.NullPointerException: null at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.adaptTimeout(AbstractSchedules.java:47) at com.oceanbase.ocp.server.common.scheduled.TenantSchedules.syncAllTenantInfo(TenantSchedules.java:43) ... 15 common frames omitted 2024-12-31 18:17:13.329 INFO 28706 --- [ocp-schedules-20,7da38be83c2b9dcf,4174bae1ce7c14a0] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster root server. 2024-12-31 18:17:13.332 INFO 28706 --- [ocp-schedules-10,ad3da8cff1503cd2,4d3fa31483319b84] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2024-12-31 18:17:13.333 INFO 28706 --- [ocp-schedules-10,ad3da8cff1503cd2,4d3fa31483319b84] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{} 2024-12-31 18:17:13.338 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : agent.log.query.http.timeout=60s 2024-12-31 18:17:13.338 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : backup.dbname.prefix=backup 2024-12-31 18:17:13.338 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : display-parse-failed-sql=true 2024-12-31 18:17:13.338 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : enable-sql.parse-service=true 2024-12-31 18:17:13.338 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.file=/home/admin/ocp-server/log/ocp.log 2024-12-31 18:17:13.338 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.file.clean-history-on-start=true 2024-12-31 18:17:13.338 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.file.max-history=100 2024-12-31 18:17:13.338 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.file.max-size=100MB 2024-12-31 18:17:13.338 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.file.name=/data2/ocp-home/logs/ocp-server.log 2024-12-31 18:17:13.338 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.file.total-size-cap=10GB 2024-12-31 18:17:13.339 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.level.com.oceanbase.ocp=INFO 2024-12-31 18:17:13.339 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.level.org.hibernate.SQL=INFO 2024-12-31 18:17:13.339 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.level.web=INFO 2024-12-31 18:17:13.339 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.pattern.console=%clr(%d{yyyy-MM-dd HH:mm:ss.SSS}){faint} %clr(%5p) %clr(28706){magenta} %clr(---){faint} %clr([%t,%X{traceId},%X{spanId}]){faint} %clr(%-40.40logger{39}){cyan} %clr(:){faint} %.-2048m%n%wEx 2024-12-31 18:17:13.339 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.pattern.file=%d{yyyy-MM-dd HH:mm:ss.SSS} %5p 28706 --- [%t,%X{traceId},%X{spanId}] %-40.40logger{39} : %.-2048m%n%wEx 2024-12-31 18:17:13.339 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : mgragent.log.level=info 2024-12-31 18:17:13.339 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : monagent.log.level=info 2024-12-31 18:17:13.339 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ob.hidden.parameter.whitelist=__min_full_resource_pool_memory,_rowsets_max_rows,_ob_max_thread_num,_enable_defensive_check,_bloom_filter_ratio,_io_read_batch_size,_io_read_redundant_limit_percentage,_enable_kv_feature 2024-12-31 18:17:13.339 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ob.logcleaner.enabled=true 2024-12-31 18:17:13.339 INFO 28706 --- [ocp-schedules-29,e3a2f3165724b8ac,65f4e8611e704430] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:17:13.339 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ob.logcleaner.run.internal=5m 2024-12-31 18:17:13.339 INFO 28706 --- [ocp-schedules-24,8bf525146800bc25,15a22e97b5d0d7f3] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:17:13.339 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.connector.cleanup.period.seconds=300 2024-12-31 18:17:13.342 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.connector.holder.capacity=2000 2024-12-31 18:17:13.342 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.connector.init.executor.thread-count=16 2024-12-31 18:17:13.342 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.connector.init.timeout.millis=10000 2024-12-31 18:17:13.342 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.connector.max-idle.seconds=3600 2024-12-31 18:17:13.342 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.ob.connection.mode=direct 2024-12-31 18:17:13.343 INFO 28706 --- [ocp-schedules-18,99d7f4a250f43619,fa48c253b5486496] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:17:13.343 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.obproxy.jdbc.connect.timeout.ms=10000 2024-12-31 18:17:13.344 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.obproxy.jdbc.socket.timeout.ms=10000 2024-12-31 18:17:13.344 INFO 28706 --- [ocp-schedules-6,af8d86a52a4f4afc,e0f177f5c806b523] c.o.o.m.service.SeriesIdCleanService : Clean series by list started. 2024-12-31 18:17:13.344 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.obproxy.vpc.jdbc.connect.timeout.ms=20000 2024-12-31 18:17:13.344 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.obproxy.vpc.jdbc.socket.timeout.ms=20000 2024-12-31 18:17:13.344 WARN 28706 --- [ocp-async-2,5cfefd5e2ec30aa1,2d9aa2d817a3f8aa] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:17:13.344 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.operation.global.timeout.millis=300000 2024-12-31 18:17:13.344 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.print.sql=true 2024-12-31 18:17:13.344 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.query.global.timeout.millis=10000 2024-12-31 18:17:13.344 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.slow.query.threshold.millis=1000 2024-12-31 18:17:13.344 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.socket.connect.timeout.millis=2000 2024-12-31 18:17:13.344 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.socket.read.timeout.millis=1800000 2024-12-31 18:17:13.344 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp-perf.anomaly.event.analyzer-sql-cpu-percent-limit=15 2024-12-31 18:17:13.345 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp-perf.sql.cure.config={"enabled":true, "analyzeRangeMin" : 5, "offsetMin": 1, "cpuPercentLimit" : 90} 2024-12-31 18:17:13.345 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp-perf.sql.cure.enabled=true 2024-12-31 18:17:13.347 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.auth.metric-auth-enabled=true 2024-12-31 18:17:13.347 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.auth.username=ocp_agent 2024-12-31 18:17:13.347 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.collect.snapshot.status=active 2024-12-31 18:17:13.347 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.home.path.prefix=/home/admin 2024-12-31 18:17:13.347 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.manager.http.port=62888 2024-12-31 18:17:13.347 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.monitor.http.port=62889 2024-12-31 18:17:13.347 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.ob-cleaner.config={"ob_log":{"disk_threshold":80,"rules":[{"file_regex":"[a-z]+.[a-z]+.log.[0-9]+","retention_days":8,"keep_percentage":60},{"file_regex":"([a-z]+.)?[a-z]+.log.wf.[0-9]+","retention_days":30,"keep_percentage":80}]},"core_log":{"disk_threshold":80,"rules":[{"file_regex":"core.[0-9]+","retention_days":8,"keep_percentage":60}]}} 2024-12-31 18:17:13.347 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.snapshot.maxsize=1GB 2024-12-31 18:17:13.348 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.version.full= 2024-12-31 18:17:13.348 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.auto.resolved.alarm-types=ob_tenant_task_timeout,ob_host_task_timeout,standby_tenant_sync_delay_too_long 2024-12-31 18:17:13.348 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.channel.modify.enabled=true 2024-12-31 18:17:13.348 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.query-slow-sql-expired-seconds=600 2024-12-31 18:17:13.348 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.query-slow-sql-timeout-seconds=3 2024-12-31 18:17:13.348 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.slow-sql-circuit-breaker-seconds=300 2024-12-31 18:17:13.348 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.slow-sql-exclude-obclusters=sys#* 2024-12-31 18:17:13.349 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.slowsql-query-limit=2000 2024-12-31 18:17:13.349 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.trans-min-duration-seconds=60 2024-12-31 18:17:13.349 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.trans-min-log-size-mb=0.5 2024-12-31 18:17:13.349 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.trans-query-limit=2000 2024-12-31 18:17:13.349 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.trans-stat-circuit-breaker-seconds=300 2024-12-31 18:17:13.350 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.trans-stat-exclude-obclusters= 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.trans.query-end-time-offset-seconds=15 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.detect.too-many-targets-alarm-threshold=20 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.enabled=true 2024-12-31 18:17:13.351 INFO 28706 --- [ocp-schedules-1,b2470a9c74b8ccd2,3b31ffcd984222ee] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:17:13.350+08:00, clusters=[] 2024-12-31 18:17:13.351 INFO 28706 --- [ocp-schedules-12,7f53f7e175a9a8dc,25dcaea803725a84] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:17:13.350+08:00, clusters=[] 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.event-readable-cluster-auth=true 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.event.resend-interval-seconds=180 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.host.property=svr_ip 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.notification.archive-batch-count=3000 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.notification.archive-once-times=100 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.notification.expired-days=90 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.query.metric-offset-seconds=10 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.query.metric.only-cache=true 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.query.minute.metric-window-ratio=3 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.query.second.metric-window-ratio=6 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.query.sql.metric-limit=2000 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.resolve-timeout-minutes=60 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.batch-max=20 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.enabled=true 2024-12-31 18:17:13.351 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.once-retry-times=1 2024-12-31 18:17:13.352 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.once-timeout-ms=10000 2024-12-31 18:17:13.352 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.period.ms=2000 2024-12-31 18:17:13.352 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.retry-timeout-minutes=60 2024-12-31 18:17:13.352 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.total-failed-retry-times=3 2024-12-31 18:17:13.352 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.total-timeout-seconds=60 2024-12-31 18:17:13.352 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.will-be-sent-in-period-seconds=1800 2024-12-31 18:17:13.352 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.enabled=false 2024-12-31 18:17:13.352 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.es.client.addresses=null 2024-12-31 18:17:13.352 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.es.client.password=null 2024-12-31 18:17:13.352 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.es.client.username=null 2024-12-31 18:17:13.352 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.es.index.keep.days=7 2024-12-31 18:17:13.353 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.es.index.replicas=1 2024-12-31 18:17:13.353 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.es.index.shards=12 2024-12-31 18:17:13.353 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.ob.log.enabled=false 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.ob.trace.enabled=false 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.audit.enabled=true 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.advanced-secondary-backup.enabled=false 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.advanced-secondary-backup.target-cloud-location= 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.advanced-secondary-backup.target-cloud-name= 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.agent.relation.file.full-path.name=#{systemProperties['user.home'].concat('/ocp-server/etc/backup_agent_ob_relations_config.yaml')} 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.alarm.backup-liboblog-expire-days=7 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.backup-command.timeout=300 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.logical.log.meta.time.continuity.threshold.seconds=10 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.obs.support.enabled=false 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.oss.support.cname=true 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.restore-time-pre-check.enabled=true 2024-12-31 18:17:13.355 INFO 28706 --- [ocp-schedules-15,df3d484ffca84fc4,1088b1add7d7b87c] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.command.timeout=3600000 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.host.task.concurrency=8 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.max.retry.times=2 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.obtain-idle-host-interval-seconds=60 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.obtain-idle-host-times=60 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.period.minutes=180 2024-12-31 18:17:13.355 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.schedule.enabled=true 2024-12-31 18:17:13.356 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.task.timeout=10800000 2024-12-31 18:17:13.356 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.build.version.check=false 2024-12-31 18:17:13.356 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ce.supported.ob.regex=^oceanbase-actiondb-(\d+\.){2}(\d+)(\.\d+)?-([\d.]+)\.([a-zA-Z0-9]+)\.(x86_64|aarch64)(\.rpm)?$ 2024-12-31 18:17:13.356 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.check.host.http.read.timeout=5000 2024-12-31 18:17:13.356 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.cloud.data.platform.site.url=null 2024-12-31 18:17:13.356 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.cloud.meta.platform.site.url=null 2024-12-31 18:17:13.356 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.cluster.obVersion.parameter.template.relation=[{"versionList":["2.2.77"],"parameterTemplateName":"ob.cluster.parameter.template.built-in.default-2-2-77.name"}] 2024-12-31 18:17:13.356 INFO 28706 --- [ocp-schedules-6,af8d86a52a4f4afc,e0f177f5c806b523] c.o.o.m.service.SeriesIdCleanService : Clean series by list finished. 2024-12-31 18:17:13.356 INFO 28706 --- [ocp-schedules-7,d9f0332f13788780,a72e58aed693894c] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:17:13.356 INFO 28706 --- [ocp-schedules-7,d9f0332f13788780,a72e58aed693894c] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:17:13.356 INFO 28706 --- [ocp-schedules-6,af8d86a52a4f4afc,e0f177f5c806b523] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache started, seriesIdKeySize=0 2024-12-31 18:17:13.356 INFO 28706 --- [ocp-schedules-6,af8d86a52a4f4afc,e0f177f5c806b523] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache ended, seriesIdKeySize=0 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config-url.site.url= 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config-url.use-request-address=true 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.cache.refresh.interval=60 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.datasource.connect-timeout=2000 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.datasource.socket-timeout=30000 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.initialSize=10 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.keepAlive=true 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.maxActive=100 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.maxWait=2000 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.minIdle=2 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.name=config-server-connect-pool 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.testWhileIdle=true 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.validationQuery=SELECT 1 FROM DUAL 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.distributed.server.expire.seconds=30 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.distributed.server.update.seconds=10 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.distributed.service.expire.seconds={CMDB_SYNCER:30, TASK_MANAGER:30, RATE_LIMIT:30, PERF_SQL_ROLLUP:30, SQL_INDEX_DIAGNOSER:30, SQL_PERF_DIAGNOSER:30, PLAN_CHANGE_DETECTOR:30, MC_MANAGER:30} 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.distributed.service.update.seconds={CMDB_SYNCER:10, TASK_MANAGER:10, RATE_LIMIT:10, PERF_SQL_ROLLUP:15, SQL_INDEX_DIAGNOSER:30, SQL_PERF_DIAGNOSER:30, PLAN_CHANGE_DETECTOR:30, MC_MANAGER:10} 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.event.snapshot.maxage-days=90 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.built-in.bucket=built-in 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.default-block-split-size=1048576 2024-12-31 18:17:13.357 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.has.signature.keywords.list=PGP,signatures 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.local.built-in.dir=/data2/ocp-home/ocp/ocp-server/lib 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.local.dir=/data2/ocp-home 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.max-concurrent-count=16 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.oss-block-split-size=1048576 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.signature.check.enabled=true 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.signature.check.invalid.keywords.list=NOT OK 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.supported-architecture=x86_64,AArch64 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.sys-package.bucket=sys-package 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.try-lock-timeout-milliseconds=60000 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.health-check.config.threshold={"-1":{"host_load":{"load1_per_cpu":2},"host_disk_status":{"host_disk_used_percent":85},"host_time":{"clock_diff":500,"ssh_interval":1000},"ob_server_disk_status":{"observer_disk_threshold_percentage":80},"ob_server_partition_count":{"ob_server_partition_count":100000},"obproxy_connection_count":{"obproxy_session_count_percentage":80}}} 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.health-check.status.available-keyword=okay 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.health-check.status.unavailable-keyword=bad 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.check.clock-diff.enable=true 2024-12-31 18:17:13.358 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.check.clock-diff.max-diff=50 2024-12-31 18:17:13.358 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:17:13.358 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.check.clock-diff.mode=0 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.clockdiff.timeout.millis=20000 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.remote-command.default-timeout-millis=30000 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.remote-command.min-timeout-millis=30000 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.ssh-ping.max-delay-millis=3000 2024-12-31 18:17:13.358 INFO 28706 --- [ocp-schedules-27,c0ef6f6839325d67,b1446454310153ae] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.account.system.active=false 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.auth=composite 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.auth.access-key.enabled=true 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.auth.basic.enabled=true 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.auth.whitelist=/api/v2/time,/api/v2/mc/info,/api/v2/sensitiveDataKey,/api/v2/obproxy/loadBalanceInfo.*,.*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName|GetObRootServiceInfoUrlTemplate|ObRootServiceUnregister|GetObTenantInfoByServiceNames|RegisterObTenantInfo|ModifyTenantInfo|DeleteTenantInfo).*,performance/ash/reports/.*/data 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.csrf.enabled=true 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.csrf.url.excluded=/api/v2/iam/login.*,.*Action=(ObRootServiceInfo|ObRootServiceRegister|ObRootServiceUnregister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName|RegisterObTenantInfo|ModifyTenantInfo|DeleteTenantInfo).*,/api/v2/monitor/metric/scan.* 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.login.client.lockout-minutes=1 2024-12-31 18:17:13.358 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.login.client.max-attempts=60 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.login.client.white-list=null 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.login.lockout-minutes=30 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.login.max-attempts=5 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.preserved.username.list=admin,sys,system,sysdba,dba,oceanbase,obproxy,proxyro,ocp,ocp_monitor,ocp_agent,odc,oms,backup,drc,lbacsys,odp,temp 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.rate-limit.enabled=true 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.rate-limit.internal-api.connect.timeout=1000 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.rate-limit.internal-api.read.timeout=1000 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.rate-limit.on-ip.enabled=false 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.rate-limit.on-user.enabled=true 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.rate-limit.task.schedule.period=3 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.role.forbidden.update.username.list=admin,system,obproxy,ocp_admin,monitor 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.sso-login-url= 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.user.access-key.max.count=5 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.idempotent.client-token.expire.time=14d 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.inspection.report.expired.cleanup.enabled=false 2024-12-31 18:17:13.359 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.inspection.report.expired.days=15 2024-12-31 18:17:13.359 INFO 28706 --- [ocp-async-4,5d104310f8af6204,72907bc498013487] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:17:13.359 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:17:13.359 INFO 28706 --- [ocp-schedules-4,e0c09fffd52a9b89,48c37ba1dc1b150d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:17:13.360 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.internal.rpc.user.username=system 2024-12-31 18:17:13.360 INFO 28706 --- [ocp-schedules-2,039cda3a45c37030,b93bbc29edd3bf6e] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:17:13.360 INFO 28706 --- [ocp-async-3,e24201a536cb5614,93dba19d83d0957c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:17:13.360 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.log.download.http.connect.timeout=180000 2024-12-31 18:17:13.360 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.log.download.http.read.timeout=180000 2024-12-31 18:17:13.360 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.log.download.tmp.dir=/data2/ocp-home/ocp/logs/ocp 2024-12-31 18:17:13.360 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.log.max-download-speed=1024 2024-12-31 18:17:13.361 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.log.query.http.read.timeout=70000 2024-12-31 18:17:13.361 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.meta.cluster.name= 2024-12-31 18:17:13.361 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.meta.disconnect.alarm.minutes=2 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.metric.async-compute.enabled=true 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.metric.collect.interval.second=15 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.async-compute.query.minute.enable=false 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.async.query.min.time.buffer.second=0 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.async.write.queue.capacity=5000000 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.enabled=true 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.host.enabled=true 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.max-pool-size=3000 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.obcluster.enabled=true 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.obproxy.enabled=true 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.obsdk.sql-query-row-limit=10000 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.request.timeout={"second_connect_timeout":1000,"second_read_timeout":1000,"second_request_timeout":2000,"minute_connect_timeout":10000,"minute_read_timeout":30000,"minute_request_timeout":40000} 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.custom.collectItem.sql.function.whiteList=count,time_to_usec,timestampdiff,coalesce,sum,max,avg,min,round,unix_timestamp,abs 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.data.retention-days={"ob_cluster_system_event":31,"ob_cluster_server_event":31,"ocp_metric_data_1":8,"ocp_metric_data_60":31,"metric_data_async":1,"metric_hour_data":1098,"metric_daily_data":1098} 2024-12-31 18:17:13.362 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.data.table-switch-time= 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.datasource.query.timeout.sec=120 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.datasource.socket.timeout.ms=120000 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.deletable.metricNames=process_count|app=HOST|name=observer,process_count|app=HOST|name=obproxy,process_cpu_percent|app=HOST|name=observer,process_cpu_percent|app=HOST|name=obproxy,process_exists|app=HOST|name=observer,process_exists|app=HOST|name=obproxy,process_fd_count|app=HOST|name=observer,process_fd_count|app=HOST|name=obproxy,process_memory_rss_bytes|app=HOST|name=observer,process_memory_rss_bytes|app=HOST|name=obproxy,process_thread_count|app=HOST|name=observer,process_thread_count|app=HOST|name=obproxy,process_uptime_seconds|app=HOST|name=observer,process_uptime_seconds|app=HOST|name=obproxy,ob_system_event_detail_total_waits,ob_system_event_detail_total_timeouts,ob_system_event_detail_time_waited_us,ob_system_event_detail_total_waits,ob_system_event_detail_total_timeouts,ob_system_event_detail_time_waited_us,ob_latch_get_total,ob_latch_miss_total,ob_latch_sleep_total,ob_latch_immediate_get_total,ob_latch_immediate_miss_total,ob_latch_spin_get_total,ob_latch_wait_seconds_total,ob_tenant_context_memory_hold_bytes,ob_tenant_context_memory_used_bytes,ob_tenant_context_memory_count 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.exporter.check-active-period-seconds=30 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.exporter.check-inactive-period-seconds=30 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.exporter.inactive.threshold.seconds=180 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.host.exporters=/metrics/node/host 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.logproxy.exporters=/metrics/logproxy 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.metric.archive.downgrade.enabled=true 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.metric.interval.factor=2 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.metric.service.type=LOCAL 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.minute.exporters=/metrics/ob/extra,/metrics/obcloud/extra 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.minute.write.queue.capacity=5000000 2024-12-31 18:17:13.363 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.ob.exporters=/metrics/node/ob,/metrics/ob/basic,/metrics/ob/extra 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.obproxy.exporters=/metrics/node/obproxy,/metrics/obproxy 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.prometheus.service.discovery.enabled=true 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.second.exporters=/metrics/node/host,/metrics/node/ob,/metrics/ob/basic,/metrics/node/obproxy,/metrics/obproxy,/metrics/node/oblb,/metrics/node/obdns,/metrics/logproxy 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.second.write.queue.capacity=5000000 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.server.exporter.auth.enabled=true 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.database=monitor_database 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.driverClassName=com.oceanbase.jdbc.Driver 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.initialSize=10 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.keepAlive=true 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.maxActive=200 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.maxWait=2000 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.minIdle=2 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.name=monitordb-connect-pool 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.testWhileIdle=true 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.validationQuery=SELECT 1 FROM DUAL 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.hikari.ConnectionTimeout=2000 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.hikari.connectionTestQuery=SELECT 1 FROM DUAL 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.hikari.maximumPoolSize=200 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.hikari.minimumIdle=10 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.hikari.poolName=monitor-connect-pool 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.host=10.79.169.37 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.password=****** 2024-12-31 18:17:13.364 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.port=2881 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.public-key=null 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.series.scan.batch-size=2000 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.username=root@ocp_monitor 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.multicloud.monitordb.password-secret-key=****** 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.network.inter-connector.agent.socks-port=1080 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.network.inter-connector.host-address=localhost 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.network.inter-connector.socks-port=1080 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.network.inter-connector.web-port=8088 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.network.vpc.mode.enabled=false 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.cluster.ops.blacklist= 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.database.name.pattern=^[a-z][a-z_0-9]{1,127}$ 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.resource.cache.enable=false 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.resource.cache.refresh.thread-core-size=20 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.resource.cache.refresh.thread-max-size=200 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.slowsql.threshold=100000 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.standby.replication.role.privilege.objects=DBA_OB_TENANTS,DBA_OB_LS_HISTORY,GV$OB_UNITS,GV$OB_PARAMETERS,GV$OB_LOG_STAT,DBA_OB_LS,DBA_OB_ACCESS_POINT 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.switchover.check.to.primary.wait-period-seconds=3 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.upgrade.allow-downgrade=false 2024-12-31 18:17:13.365 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.upgrade.clean-tmp-rpm=true 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.upgrade.dependencies.full-path.name=#{systemProperties['user.home'].concat('/ocp-server/etc/oceanbase_upgrade_dep.yml')} 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.upgrade.script.cmd.timeout=0 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.obcloud.api.address= 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.obproxy.query-with-ob-connections=true 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.cgroup.minimum-ob-version=4.0.0.0 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.default.os.user=admin 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.connector.cache.max-idle-seconds=3600 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.connect-timeout=5000 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.connection.max-per-route=100 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.connection.max-pool-size=100 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.read-timeout=30000 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.socket-timeout=3000 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.thread.core-pool-size=500 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.thread.keep-alive-time=120000 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.thread.max-pool-size=1500 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.ssh.connect-timeout=10000 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.ssh.default-command-timeout=10000 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.delete-server.reserve-data-enabled=false 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.host.arm-lse-supported=true 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.resource.trend.max-point=1440 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.server.skip-io-bench=false 2024-12-31 18:17:13.366 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.single-idc-for-zone-enabled=true 2024-12-31 18:17:13.367 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.sql-execute.enabled=false 2024-12-31 18:17:13.367 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.sql-execute.sql-type.whitelist=SELECT,SHOW 2024-12-31 18:17:13.367 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.tenant.whitelist.attach-default-whitelist=true 2024-12-31 18:17:13.367 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.unit.unused.max-reserve-hour=1 2024-12-31 18:17:13.367 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.obproxy.prohibit.obsharding.operation=true 2024-12-31 18:17:13.367 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.obproxy.readonly.default.password=****** 2024-12-31 18:17:13.367 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.obproxy.readonly.default.username=proxyro 2024-12-31 18:17:13.367 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.obproxy.skip-set-proxyro-password=****** 2024-12-31 18:17:13.367 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.odp.root.default.password=****** 2024-12-31 18:17:13.367 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.alarm.status.refresh.interval=10000 2024-12-31 18:17:13.367 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.backup.status.refresh.interval=300000 2024-12-31 18:17:13.367 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.cluster.status.refresh.interval=10000 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.host.status.refresh.interval=10000 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.obproxy.status.refresh.interval=10000 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.performance.status.refresh.interval=300000 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.tasks.status.refresh.interval=10000 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.tenant.status.refresh.interval=10000 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.ash.earliest-analyse-time=8 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.ash.max-analyse-range=60m 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.ash.report-retention-days=90 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.big.transaction.log.threshold.byte=524288 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.big.transaction.time.threshold.ms=500 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.collect.metadb.enabled=false 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.count-sql.slow-sql-explicitly=true 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.oas.stat.enabled=true 2024-12-31 18:17:13.369 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.ocp.monitor.password=****** 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.ocp.monitor.public.key=****** 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.parallel.sql.limit=2000 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.parallel.sql.partition.retention.days=15 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.snapshot.generation.enable=0 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.snapshot.generation.enable.in.147x-meta-cluster=false 2024-12-31 18:17:13.370 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:17:13.370 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:17:13.370 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.snapshot.generation.white-list=null 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.awful-performance-index-used-config={"enabled":true, "cpuTimeLimitUs":100000, "execPsLimit":5.0, "fullLogicalReadsLimit":1000} 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.cpu-time-proportion-high-config={"enabled":true, "cpuTimeLimitUs":10000, "execPsLimit":10.0, "maxCpuTimeLimitUs":30000, "affectedRowsLimit":100, "execLimit":30, "sqlCountLimit":20, "cpuTimePercentLimit":20} 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.database-white-list=oceanbase,information_schema,mysql,__recyclebin,sys,__public 2024-12-31 18:17:13.370 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.diagnose.standby-cluster.enabled=False 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.execution-spike-config={"enabled":true, "cpuTimeLimitUs":3000, "execPsLimit":5.0, "pointsLimit":5, "compareMin":20, "avgExecutionMultiply":{"0":6, "1":5, "5":4, "10":3, "50": 2.5, "100": 2, "500": 1.6}, "stdExecutionMultiply":{"0":80, "1":60 , "3": 30,"5":20, "10":15, "20":8, "30":6, "50":5, "80":4}} 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.index-diagnoser-config={"enabled":true,"schedulePeriodMin":5, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":10000,"diagPeriodSec":300,"diagOffsetSec":60,"maxDiagPeriodSec":1800} 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.ineffective-hint-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.outline-history-query-days=30 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.perf-diagnoser-config={"enabled":true,"schedulePeriodMin":5, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":10000,"diagPeriodSec":300,"diagOffsetSec":60,"maxDiagPeriodSec":1800} 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.performance-degradation-after-plan-changed-config={"enabled":true, "compareMin":5, "cpuTimeMultiply":{"0":50, "1":20, "10":10, "100":3, "1000":2},"alarm":true} 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.performance-degradation-config={"enabled":true, "cpuTimeLimitUs":10000, "execPsLimit":5.0, "maxCpuTimeLimitUs":30000, "affectedRowsLimit":100, "execLimit":5, "compareMin":20, "cpuTimeMultiply":{"0":50, "1":20, "10":10, "100":3, "1000":2}, "alarm":true, "sysTenantEnabled":false} 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.query-timeout=30000000 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.row-lock-contention-high-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":100000, "elapsedTimeLimitUs":0} 2024-12-31 18:17:13.370 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.sql-diagnosis-retention-days=30 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.table-scan-index-not-exists-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.table-scan-index-not-used-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.tenant-white-list=null 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.advisor-plan-max-query-range=7d 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag-plan-change-config={"enabled":true,"schedulePeriodMin":2, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":500,"diagPeriodSec":120,"diagOffsetSec":120,"maxDiagPeriodSec":600} 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.affected-rows-threshold=50000 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.core-pool-size=30 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.max-period-timeUs=1800000000 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.max-pool-size=300 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.max-queue-size=1000000 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.max-thread-pool-task-limit=50000 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.partition-count-threshold=2000 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.return-rows-threshold=50000 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-queue-max-size=1000000 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-worker-core-size=30 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-worker-max-size=300 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.earliest-query-time=8d 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.high-risk-inspect-service.enable=True 2024-12-31 18:17:13.371 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.high-risk-max-query-range=7d 2024-12-31 18:17:13.372 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.index-advisor-cpu-time-threshold=10 2024-12-31 18:17:13.372 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.index-advisor-elapsed-time-threshold=20 2024-12-31 18:17:13.372 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.info.parameterize.sql=false 2024-12-31 18:17:13.372 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.info.parse.sql.type=true 2024-12-31 18:17:13.372 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.max-query-range=24h 2024-12-31 18:17:13.372 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.new-sql.limit=2000 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.new-sql.query.compare.interval.days=7 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.new-sql.query.interval.days=7d 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.oas.schema-advice.rows.limit=1000000 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.oas.schema-advice.table.limit=32 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.oas.schema-advice.table4.limit=20 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.parse.batch.insert.size=100 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.parse.core.thread=8 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.parse.insert.query.rate.limit=10 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.parse.max.thread=16 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.parse.query.limit=2000 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.parse.queue.size=20000 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-granularity=30s 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-query-interval=2h 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-retention=5d 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.prepare-partition-ahead=8 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.query-digest-limit=0 2024-12-31 18:17:13.373 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.query-digest-trend.points=15 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.query-timeout=30000000 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.query.high-risk-sql.sql-text-short-length=50 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.slow-sql-limit=2000 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-audit-sample-retention=7d 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-granularity=30s 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-query-interval=2h 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-retention=2d 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-granularity=2m 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-query-interval=12h 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-retention=8d 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-granularity=10m 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-query-interval=48h 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-retention=15d 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-info-secondary-cache-expiration=10m 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-query-digest-level0-query-interval=30m 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-query-digest-level1-query-interval=2h 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-stat-rollup-worker-disabled=false 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-stat-rollup-worker-disabled.in.147x-meta-cluster=true 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.top-sql-limit=2000 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.top-sql.query-parallel=0 2024-12-31 18:17:13.374 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.tuning-advisor-cpu-time-multiply-of-plan-comparison={"0":10, "1":5, "10":2, "100":1.5, "1000":1.2} 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.tuning-advisor-cpu-time-ratio-of-plan-comparison=0.8 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.detail.query.range.minute=30 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.interval.second=5 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.long.transaction.threshold.second=60 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.partition.retention.days=7 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.pending.transaction.threshold.second=60 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.query.sql.sample.timeout.second=30 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.sql.count.limit=10000 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.workload.generate-report-thread-count=5 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.workload.report.tenant-top-sql-limit=10 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.request.client.ip.from-header=false 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.request.client.ip.header-candidates=X-Forwarded-For 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.sensitive-data.encryption.private-key=****** 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.sensitive-data.encryption.public-key=****** 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.server.event.included={sql: {}, daily_merge:{}, election:{}, physical_restore:{}, observice:{}, observer:{}, clog_restore:{}, warmup:{}, log_archive:{}, archive_log:{}, minor_merge:{}, ddl:{"create_partition", "batch_create_partition", "add_replica", "remove_member", "batch_remove_member", "batch_modify_quorum", "batch_change_replica", "migrate_replica", "remove_replica", "rebuild_replica"}, freeze:{"do minor freeze fail"}, storage:{"add_replica failed", "migrate_replica failed", "reubild_replica failed", "change_replica failed", "log is new enough, turn off rebuild flag", "remove_replica failed", "restore follower replica failed", "restore_replica failed", "batch change_replica failed", "copy global index failed", "restore_standby_replica failed", "rebuild_replica failed"}} 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.server.readonly.mode.enabled=false 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.site.url=http://10.79.169.37:8080 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.standby.tenant.delay.threshold=5000 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.startup-check.metadb.variable=[{"variableName": "max_allowed_packet", "operator": ">=", "targetValue": 4194304}, {"variableName": "ob_read_consistency", "operator": "=", "targetValue": "STRONG"}] 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.startup-check.monitordb.variable=[{"variableName": "max_allowed_packet", "operator": ">=", "targetValue": 4194304}, {"variableName": "ob_read_consistency", "operator": "=", "targetValue": "STRONG"}] 2024-12-31 18:17:13.375 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.subtask.minimum-timeout-secs=-1 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.subtask.prohibit.skip.names=[] 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.default.language=zh-CN 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.default.timezone= 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.event.excluded={balancer: {"start_sql_bkgd_task","finish_sql_bkgd_task"}, schema_recycler: {}} 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.obproxy.metadb.cluster-name=obdv1 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.obproxy.metadb.database=obproxy 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.obproxy.metadb.enabled=false 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.obproxy.metadb.sensitive-info={"configuredInfo":{"antmeta":{"root@sys":"9f6e186723de2f4873cad637e0e8b6e9"},"obdv1":{"root@obproxy":"8f3bab5c8face32f3a7da34de0773c9b"}},"defaultInfo":{"default":"899f7ad059fc3a3c19dee85886a8f45a7e67dd4896dbeb93"}} 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.obproxy.metadb.user=root@obproxy 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.table-cleaning.batch-interval-millis=10 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.table-cleaning.batch-size=1000 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.table-cleaning.preserve-days=30 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.table-cleaning.thread.core-pool-size=4 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.table-cleaning.thread.maximum-pool-size=16 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.tag.usage.max.count=5000 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.prohibit.skip.names=["Upgrade OB cluster"] 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.alarmDetectOnce.fixedDelay=10 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.alarmDetectOnce.initialDelay=60 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.fixAlarmTarget.fixedDelay=60 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.fixAlarmTarget.initialDelay=60 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshActiveAlarmStatus.fixedDelay=60 2024-12-31 18:17:13.376 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshActiveAlarmStatus.initialDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAggregators.fixedDelay=10 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAggregators.initialDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmInMemory.fixedDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmInMemory.initialDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmSummary.fixedDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmSummary.initialDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmTargets.fixedDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmTargets.initialDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmTaskManager.fixedDelay=20 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmTaskManager.initialDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshBackupAlarmStat.fixedDelay=180 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshBackupAlarmStat.initialDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshDetectorFactory.fixedDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshDetectorFactory.initialDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshGlobalSilencer.fixedDelay=10 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshGlobalSilencer.initialDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshHostAlarmInfo.fixedDelay=600 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshHostAlarmInfo.initialDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.removeInactiveAlarmEvents.fixedDelay=600 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.removeInactiveAlarmEvents.initialDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.resolveAlarmsOfAbsentTargets.fixedDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.resolveAlarmsOfAbsentTargets.initialDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.binlog.syncBinlogClusters.fixedDelay=30 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.binlog.syncBinlogInstances.fixedDelay=60 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkCpuBindCore.fixedRate=30 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkCpuBindCore.initialDelay=120 2024-12-31 18:17:13.377 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostAgentStatus.fixedRate=30 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostAgentStatus.initialDelay=120 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostClockDiff.fixedRate=30 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostClockDiff.initialDelay=120 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostStatus.fixedRate=30 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostStatus.initialDelay=120 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostVersion.fixedDelay=4 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostVersion.initialDelay=30 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostVersion.timeUnit=MINUTES 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.getHostAgentAlarms.fixedDelay=1 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.getHostAgentAlarms.initialDelay=2 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.getHostAgentAlarms.timeUnit=MINUTES 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.refreshAgentConfig.fixedDelay=10 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.refreshAgentConfig.initialDelay=2 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.refreshAgentConfig.timeUnit=MINUTES 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.checkOdpClient.fixedDelay=60 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.checkVpcConnect.fixedDelay=5 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.cleanTaskLog.cron=0 10 3 * * * 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.cleanTaskRecords.cron=0 20 5 * * * 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.cleanTmpLogFiles.cron=0 20 4 * * * 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.cleanupDruidCache.fixedDelay=300 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.cleanupDruidCache.initialDelay=600 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.collectOdpMetrics.fixedDelay=60 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.ocpReplicationDaemon.fixedDelay=5 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.partitionDaemon.fixedDelay=600 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.partitionDaemon.initialDelay=120 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.refreshOcpConfig.fixedDelay=180 2024-12-31 18:17:13.378 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.checkAllArbitrationService.fixedRate=30 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.checkClusterRootServer.fixedRate=300 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.checkClusterStatus.fixedRate=30 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.checkStandbyClusterInfo.fixedRate=30 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.collectAllClusterCompaction.fixedDelay=60 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.syncClusterInfo.fixedRate=30 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.syncClusterSystemEvent.fixedDelay=600 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.syncRootServer.fixedDelay=120 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obTenant.checkAllStandbyTenant.fixedRate=30 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obTenant.checkAllTenantServiceNameConflict.fixedDelay=60 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obTenant.collectAllTenantMajorCompaction.fixedDelay=60 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obTenant.collectAllTenantMiniCompaction.fixedDelay=300 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obTenant.syncAllTenantInfo.fixedDelay=60 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obproxy.checkObproxyServers.cron=10/30 * * * * * 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obproxy.checkObproxyServers.initialDelay=120 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obproxy.collectObproxyMetrics.cron=10/30 * * * * * 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obproxy.collectObproxyMetrics.initialDelay=120 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.perf.collectHighSqlAuditStat.fixedDelay=300 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.perf.collectHighSqlAuditStat.initialDelay=120 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.perf.collectSlowSqlForAlarm.fixedDelay=60 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.perf.collectTransStatForAlarm.fixedDelay=60 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.perf.oasSqlCuring.fixedDelay=60 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.pool.coreSize=30 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.tenant.username.pattern.mysql=^[a-z][a-z_0-9]{1,127}$ 2024-12-31 18:17:13.379 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.version=4.3.2 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.version.full=4.3.2-20241012145836 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.web.context-path=/ 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.web.tracking.enabled=1 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : odp.client.automatic-match-work-thread=false 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : odp.client.enable-strict-kernel-release=false 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : odp.client.log-dir-size-threshold=1G 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : odp.client.proxy-mem-limited=1G 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : odp.client.syslog-level=INFO 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : odp.client.work-thread-num=8 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : perf.sql.top-sql-comparison.elapsed-time-increase-limit=0.2 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : perf.sql.top-sql-comparison.error-percentage-increase-limit=0.1 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : perf.sql.top-sql-comparison.executions-increase-limit=0.2 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : perf.sql.top-sql-comparison.new-in-top-n-limit=100 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : perf.sql.top-sql-comparison.remote-plan-percentage-increase-limit=0.1 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : perf.sql.top-sql-comparison.return-rows-increase-limit=0.2 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.address=0.0.0.0 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.port=8090 2024-12-31 18:17:13.380 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.servlet.session.cookie.name=SESSION 2024-12-31 18:17:13.381 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.servlet.session.cookie.same-site=null 2024-12-31 18:17:13.381 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.servlet.session.cookie.secure=null 2024-12-31 18:17:13.381 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.servlet.session.timeout=30m 2024-12-31 18:17:13.383 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.ssl.enabled=false 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.ssl.key-alias=null 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.ssl.key-password=null 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.ssl.key-store= 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.ssl.key-store-password=****** 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.ssl.key-store-type=PKCS12 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : slow-sql.query-sql-info-from.cache.directly=false 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.data.web.pageable.max-page-size=5000 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.data.web.pageable.one-indexed-parameters=true 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.initialSize=10 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.keepAlive=true 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.maxActive=200 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.maxWait=2000 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.minIdle=2 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.name=metadb-connect-pool 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.testWhileIdle=true 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.validationQuery=SELECT 1 FROM DUAL 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.hikari.ConnectionTimeout=2000 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.hikari.connectionTestQuery=SELECT 1 FROM DUAL 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.hikari.maximumPoolSize=200 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.hikari.minimumIdle=10 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.hikari.poolName=metadb-connect-pool 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.jpa.hibernate.naming-strategy=org.hibernate.cfg.ImprovedNamingStrategy 2024-12-31 18:17:13.384 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.jpa.properties.hibernate.dialect=org.hibernate.dialect.MySQL5Dialect 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.jpa.properties.hibernate.globally_quoted_identifiers=true 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.servlet.multipart.enabled=true 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.servlet.multipart.max-file-size=2048MB 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.servlet.multipart.max-request-size=2048MB 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : springdoc.api-docs.enabled=false 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : springdoc.api-docs.path=/doc/api-docs 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : springdoc.paths-to-exclude=null 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : springdoc.paths-to-match=/api/v2/** 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : springdoc.swagger-ui.path=/doc/swagger-ui.html 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : sql-stat.flush-sql-info-to-cache=true 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : storage.capacity.compute.executor.core-pool-size=8 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : storage.capacity.compute.executor.max-pool-size=64 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : storage.capacity.compute.executor.task-queue-size=1800 2024-12-31 18:17:13.385 INFO 28706 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ****************************************************************************** 2024-12-31 18:17:13.390 INFO 28706 --- [main,,] c.oceanbase.ocp.OcpCeServerApplication : Started OcpCeServerApplication in 336.534 seconds (JVM running for 337.753) 2024-12-31 18:17:13.391 INFO 28706 --- [ocp-schedules-2,039cda3a45c37030,b93bbc29edd3bf6e] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:17:13.413 INFO 28706 --- [ocp-schedules-4,e0c09fffd52a9b89,48c37ba1dc1b150d] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:17:13.420 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:17:13.423 INFO 28706 --- [main,,] c.o.o.s.c.analyzer.OcpPostStartupRunner : Setup sensitive data utils, publicKey=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC4RG0d4r/p1eGjCZdy5fsVy1p2XSAATOFPv/XgcWlRRTb7Z+M+WxoSjwqNllEJuKXpoVnWdcDnjtR61lwMy+yS5mrxHN+vUh2ssZNuVXEQ3VXBn2AB6DbJp5xMcHYRbyAe5P866kCUaSRaoG1WTGbXRVOizbKwmkA1EYXDgj9sGwIDAQAB 2024-12-31 18:17:13.425 INFO 28706 --- [ocp-schedules-14,8f4010c7d28c9f9f,9c7f3689c9e4d0cf] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:17:13.426 INFO 28706 --- [ocp-schedules-14,8f4010c7d28c9f9f,9c7f3689c9e4d0cf] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 0 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Metadb, table=profile_credential_sharing 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Metadb, table=ocp_cache_info 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_0 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_1 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_2 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sqltext 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_dynamic_sql 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_high_risk_sql 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan_explain 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_sample 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_perf_sql_diagnosis_task 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_perf_sql_diagnosis 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_active_session_stat_0 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_snapshot 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_cluster 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_tenant 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_server 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_replica 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sysstat 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_row_lock 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_latch 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_cache 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_parameter 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_rpc 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_packet 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_clog 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_location_cache 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_gts 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_system_event 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_memory 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_partition_hit 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_plan_monitor 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_trans_stat_v2 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_cluster_system_event 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_cluster_server_event 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_metric_data_1 2024-12-31 18:17:13.427 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_metric_data_60 2024-12-31 18:17:13.429 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_hour_data 2024-12-31 18:17:13.429 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_daily_data 2024-12-31 18:17:13.429 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_second 2024-12-31 18:17:13.429 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_minute 2024-12-31 18:17:13.429 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_hour 2024-12-31 18:17:13.429 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_daily 2024-12-31 18:17:13.429 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_async 2024-12-31 18:17:13.429 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=sql_aggregate_data 2024-12-31 18:17:13.429 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_partition_stats_compressed 2024-12-31 18:17:13.429 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_tenant_mini_compaction_info 2024-12-31 18:17:13.430 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:17:13.430 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:17:13.431 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:17:13.431 ERROR 28706 --- [ocp-async-9,ec35e0b70f7b9fe7,023cff1ab4a8bcc0] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.NotFoundException occurred with code error.common.not.found, and args [task not exist., 999989] 2024-12-31 18:17:13.431 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:17:13.431 INFO 28706 --- [ocp-async-9,ec35e0b70f7b9fe7,023cff1ab4a8bcc0] c.o.o.c.t.e.m.TaskDefinitionManagerImpl : Task not found, task id :999989 2024-12-31 18:17:13.431 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:17:13.431 INFO 28706 --- [ocp-async-9,ec35e0b70f7b9fe7,023cff1ab4a8bcc0] c.o.o.s.c.l.ApplicationStartedListener : Begin to init proxyro password config in sys tenant 2024-12-31 18:17:13.432 INFO 28706 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167004] Submitting initial worker 2024-12-31 18:17:13.436 INFO 28706 --- [ocp-async-9,ec35e0b70f7b9fe7,023cff1ab4a8bcc0] c.o.o.s.c.l.ApplicationStartedListener : Success to init proxyro password config in sys tenant 2024-12-31 18:17:13.442 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:17:13.445 INFO 28706 --- [ocp-schedules-17,9e825e9ff0f218ef,9d949b734f9e6a06] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache started, seriesIdKeySize=0 2024-12-31 18:17:13.445 INFO 28706 --- [ocp-schedules-17,9e825e9ff0f218ef,9d949b734f9e6a06] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache ended, seriesIdKeySize=0 2024-12-31 18:17:13.500 INFO 28706 --- [ocp-schedules-23,90745caa34e1d597,0cd4724fd0409460] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:17:13.500 INFO 28706 --- [ocp-schedules-23,90745caa34e1d597,0cd4724fd0409460] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:17:13.546 INFO 28706 --- [main,,] c.o.o.s.c.analyzer.OcpPostStartupRunner : OCP application uuid is e261483c3c9d413780ef23b2dcfa4157. 2024-12-31 18:17:13.546 INFO 28706 --- [main,,] c.o.o.s.c.analyzer.OcpPostStartupRunner : OCP boot ok! 2024-12-31 18:17:13.549 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT5M36.692756152S 2024-12-31 18:17:13.549 INFO 28706 --- [main,,] c.o.o.b.spring.BootstrapRunListener : ocp is ready! 2024-12-31 18:17:13.553 INFO 28706 --- [ocp-async-2,eed8ffca229cc548,8457a383aa2b2a4d] c.o.o.p.a.i.SessionEventSyncService : start to sync session wait event info, cluster ids is [] 2024-12-31 18:17:13.553 INFO 28706 --- [ocp-async-2,eed8ffca229cc548,8457a383aa2b2a4d] c.o.o.p.a.i.SessionEventSyncService : Sync session wait event info finished, cluster ids is [] 2024-12-31 18:17:13.554 INFO 28706 --- [main,,] c.o.o.b.ext.ReinstallAgentAfterUpgrade : ReinstallAgentAfterUpgrade created 2024-12-31 18:17:13.554 INFO 28706 --- [main,,] c.o.o.b.ext.SetProxyIdAfterUpgrade : SetProxyIdAfterUpgrade created. 2024-12-31 18:17:13.564 WARN 28706 --- [main,,] c.o.o.o.i.ObproxyOperationServiceImpl : No obproxy needs to set proxy_id, input param is empty. 2024-12-31 18:17:13.564 INFO 28706 --- [main,,] c.o.o.b.ext.SetProxyIdAfterUpgrade : Submit task null success, assign proxy_id for obproxies []. 2024-12-31 18:17:13.564 INFO 28706 --- [main,,] c.o.o.b.ext.ReinstallAgentAfterUpgrade : not UPGRADE, skip reinstall agent 2024-12-31 18:17:13.582 INFO 28706 --- [ocp-schedules-23,90745caa34e1d597,0cd4724fd0409460] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:17:13.582 INFO 28706 --- [ocp-schedules-23,90745caa34e1d597,0cd4724fd0409460] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:17:13.748 INFO 28706 --- [ocp-async-10,0476c8371981f4e0,cccee82265861f31] c.o.o.c.t.e.coordinator.TaskCoordinator : Start task coordinator 2024-12-31 18:17:13.796 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2024-12-31 18:17:13.874 INFO 28706 --- [ocp-async-10,0476c8371981f4e0,cccee82265861f31] c.o.o.s.common.config.TaskEngineRunner : Startup subtask coordinator. subtask=592 2024-12-31 18:17:13.874 INFO 28706 --- [ocp-async-10,0476c8371981f4e0,cccee82265861f31] c.o.o.c.t.e.c.SubtaskCoordinator : Start subtask coordinator 2024-12-31 18:17:14.151 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.781212596S 2024-12-31 18:17:14.151 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:17:14.227 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2024-12-31 18:17:14.227 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2024-12-31 18:17:14.263 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 2024-12-31 18:17:14.337 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:17:14.337 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:17:14.337 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:17:14.337 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:17:14.337 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:17:14.338 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2024-12-31 18:17:14.346 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:17:14.456 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] o.s.boot.SpringApplication : Started application in 1.098 seconds (JVM running for 338.819) 2024-12-31 18:17:14.456 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT1.098413468S 2024-12-31 18:17:14.941 INFO 28706 --- [ocp-schedules-9,fbac47ac017fd597,cf3a70f7a99dbddc] c.o.ocp.core.property.PropertyService : Refresh config properties done 2024-12-31 18:17:14.982 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:17:14.984 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:17:15.312 WARN 28706 --- [ocp-async-4,dee338754962235e,01684b73ced793ff] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:17:15.314 INFO 28706 --- [ocp-async-7,e8d193f9bb150e5e,11e3f4bc064bd6fc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:17:15.707 INFO 28706 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:17:15.731 INFO 28706 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:17:17.313 WARN 28706 --- [ocp-async-10,0b98350cd42194fd,9540bedbed23446e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:17:17.313 INFO 28706 --- [ocp-async-5,6e9669f13cb85e6f,f111b2a84ef78382] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:17:17.984 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:17:17.987 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:17:19.313 WARN 28706 --- [ocp-async-9,f9ac9868a7f06499,216e2392b0ed549c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:17:19.313 INFO 28706 --- [ocp-async-6,1f5472f9e16b38ea,7fc1495313d6ad5d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:17:20.987 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:17:20.990 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:17:21.313 WARN 28706 --- [ocp-async-2,b5bdc0571839420b,b27297f50c150ba9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:17:21.313 INFO 28706 --- [ocp-async-2,7f7666ffb0834b7b,1de1a7eb3b4cfd67] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:17:23.312 INFO 28706 --- [ocp-schedules-6,061f39398dd152e7,58bc4b80aa1ba048] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:17:23.314 WARN 28706 --- [ocp-async-8,4972145059981290,541e796cda88061b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:17:23.314 INFO 28706 --- [ocp-async-7,685a035d696e68d1,646a785fd7c8a866] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:17:23.314 INFO 28706 --- [ocp-async-9,ad4659b8ded1d1af,092377f0e6ed382d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:17:23.990 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:17:23.992 INFO 28706 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:17:42.229 INFO 34018 --- [main,,] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:17:42.229 INFO 34018 --- [main,,] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:17:42.230 INFO 34018 --- [main,,] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:17:42.230 INFO 34018 --- [main,,] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:17:42.230 INFO 34018 --- [main,,] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:17:42.231 INFO 34018 --- [main,,] c.oceanbase.ocp.OcpCeServerApplication : The following 1 profile is active: "composite" 2024-12-31 18:17:42.245 INFO 34018 --- [main,,] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:17:50.143 INFO 34018 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Multiple Spring Data modules found, entering strict repository configuration mode 2024-12-31 18:17:50.144 INFO 34018 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2024-12-31 18:17:50.383 INFO 34018 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 207 ms. Found 4 JPA repository interfaces. 2024-12-31 18:17:50.397 INFO 34018 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Multiple Spring Data modules found, entering strict repository configuration mode 2024-12-31 18:17:50.397 INFO 34018 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2024-12-31 18:17:50.672 INFO 34018 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 274 ms. Found 16 JPA repository interfaces. 2024-12-31 18:17:50.673 INFO 34018 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Multiple Spring Data modules found, entering strict repository configuration mode 2024-12-31 18:17:50.673 INFO 34018 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data JPA repositories in DEFAULT mode. 2024-12-31 18:17:52.120 INFO 34018 --- [main,,] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 1446 ms. Found 157 JPA repository interfaces. 2024-12-31 18:17:55.839 INFO 34018 --- [main,,] o.s.cloud.context.scope.GenericScope : BeanFactory id=0f233f8c-7d1e-3396-84b4-7fa06161d9e7 2024-12-31 18:17:57.529 INFO 34018 --- [main,,] trationDelegate$BeanPostProcessorChecker : Bean 'commonSecurityConfiguration.MethodSecurityConfiguration' of type [com.oceanbase.ocp.server.common.config.security.conf.CommonSecurityConfiguration$MethodSecurityConfiguration$$EnhancerBySpringCGLIB$$7b7a829f] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying) 2024-12-31 18:17:57.561 INFO 34018 --- [main,,] .o.s.c.c.s.c.CommonSecurityConfiguration : Method-level access control enabled. 2024-12-31 18:17:58.652 INFO 34018 --- [main,,] c.o.o.s.c.c.w.MetadbHikariConfigHelper : [metadb] driver class=com.oceanbase.jdbc.Driver 2024-12-31 18:17:58.652 INFO 34018 --- [main,,] c.o.o.s.c.c.w.MetadbHikariConfigHelper : [metadb] username=root@ocp_meta 2024-12-31 18:17:58.652 INFO 34018 --- [main,,] c.o.o.s.c.c.w.MetadbHikariConfigHelper : [metadb] jdbc url=jdbc:oceanbase://10.79.169.37:2881/meta_database?useUnicode=true&characterEncoding=UTF8&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull 2024-12-31 18:17:58.661 INFO 34018 --- [main,,] com.zaxxer.hikari.HikariDataSource : metadb-connect-pool - Starting... 2024-12-31 18:17:58.736 INFO 34018 --- [main,,] com.zaxxer.hikari.HikariDataSource : metadb-connect-pool - Start completed. 2024-12-31 18:17:58.749 INFO 34018 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : begin AfterDataSourceCreationHook 2024-12-31 18:17:58.749 INFO 34018 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : end AfterDataSourceCreationHook 2024-12-31 18:17:58.794 INFO 34018 --- [main,,] c.o.o.c.distributed.server.LocalServer : Local server, id=10.79.169.37:8090, name=a9efd8d51e 2024-12-31 18:17:58.874 WARN 34018 --- [main,,] c.o.o.c.d.server.DefaultServerUpdater : Deleted expired server: DistributedServer{id=10.79.169.37:8090, name=a9efd8d51e, expireInSeconds=30, createTime=2024-12-31T18:14:07+08:00, updateTime=2024-12-31T18:17:23+08:00, expireTime=2024-12-31T18:17:53+08:00, isActive=false} 2024-12-31 18:17:58.915 INFO 34018 --- [main,,] c.o.o.c.d.s.DistributedServerManager : DistributedServer updater scheduler started on 10.79.169.37:8090 2024-12-31 18:18:00.262 INFO 34018 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat initialized with port(s): 8090 (http) 2024-12-31 18:18:00.296 INFO 34018 --- [main,,] o.apache.catalina.core.StandardService : Starting service [Tomcat] 2024-12-31 18:18:00.296 INFO 34018 --- [main,,] org.apache.catalina.core.StandardEngine : Starting Servlet engine: [Apache Tomcat/9.0.83] 2024-12-31 18:18:00.544 INFO 34018 --- [main,,] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring embedded WebApplicationContext 2024-12-31 18:18:00.545 INFO 34018 --- [main,,] w.s.c.ServletWebServerApplicationContext : Root WebApplicationContext: initialization completed in 18300 ms 2024-12-31 18:18:01.639 INFO 34018 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2024-12-31 18:18:02.123 INFO 34018 --- [main,,] org.hibernate.Version : HHH000412: Hibernate ORM core version 5.6.15.Final 2024-12-31 18:18:03.319 INFO 34018 --- [main,,] o.hibernate.annotations.common.Version : HCANN000001: Hibernate Commons Annotations {5.1.2.Final} 2024-12-31 18:18:08.011 INFO 34018 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2024-12-31 18:18:09.687 WARN 34018 --- [main,,] o.h.t.d.java.JavaTypeDescriptorRegistry : HHH000481: Encountered Java type [class com.fasterxml.jackson.databind.JsonNode] for which we could not locate a JavaTypeDescriptor and which does not appear to implement equals and/or hashCode. This can lead to significant performance problems when performing equality/dirty checking involving this Java type. Consider registering a custom JavaTypeDescriptor or at least implementing equals/hashCode. 2024-12-31 18:18:10.937 WARN 34018 --- [main,,] org.hibernate.mapping.RootClass : HHH000038: Composite-id class does not override equals(): com.oceanbase.ocp.core.metadb.repo.iam.jdbcsession.SpringJdbcSessionAttributeKey 2024-12-31 18:18:10.937 WARN 34018 --- [main,,] org.hibernate.mapping.RootClass : HHH000039: Composite-id class does not override hashCode(): com.oceanbase.ocp.core.metadb.repo.iam.jdbcsession.SpringJdbcSessionAttributeKey 2024-12-31 18:18:15.706 INFO 34018 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2024-12-31 18:18:15.787 INFO 34018 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2024-12-31 18:18:18.162 INFO 34018 --- [main,,] c.o.o.monitor.MonitorBeanConfiguration : ocp-monitor bean configuration done 2024-12-31 18:18:18.969 INFO 34018 --- [main,,] c.o.ocp.ha.maz.OcpMultiAzoneServiceImpl : OCP multi-azone not enabled 2024-12-31 18:18:18.981 INFO 34018 --- [main,,] .o.o.s.c.c.w.MonitordbHikariConfigHelper : [monitordb] driver class=com.oceanbase.jdbc.Driver 2024-12-31 18:18:18.981 INFO 34018 --- [main,,] .o.o.s.c.c.w.MonitordbHikariConfigHelper : [monitordb] username=root@ocp_monitor 2024-12-31 18:18:18.981 INFO 34018 --- [main,,] .o.o.s.c.c.w.MonitordbHikariConfigHelper : [monitordb] jdbc url=jdbc:oceanbase://10.79.169.37:2881/monitor_database?useUnicode=true&characterEncoding=utf-8&encloseParamInParentheses=false&connectTimeout=2000&socketTimeout=120000&rewriteBatchedStatements=true&allowMultiQueries=true&zeroDateTimeBehavior=convertToNull 2024-12-31 18:18:18.981 INFO 34018 --- [main,,] com.zaxxer.hikari.HikariDataSource : monitor-connect-pool - Starting... 2024-12-31 18:18:18.986 INFO 34018 --- [main,,] com.zaxxer.hikari.HikariDataSource : monitor-connect-pool - Start completed. 2024-12-31 18:18:18.986 INFO 34018 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : begin AfterDataSourceCreationHook 2024-12-31 18:18:18.987 INFO 34018 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : end AfterDataSourceCreationHook 2024-12-31 18:18:19.032 INFO 34018 --- [main,,] .o.s.c.c.w.ConfigServerDataSourceWrapper : [config server datasource] driver class=com.oceanbase.jdbc.Driver 2024-12-31 18:18:19.032 INFO 34018 --- [main,,] .o.s.c.c.w.ConfigServerDataSourceWrapper : [config server datasource] username=root@ocp_meta 2024-12-31 18:18:19.032 INFO 34018 --- [main,,] .o.s.c.c.w.ConfigServerDataSourceWrapper : [config server datasource] jdbc url=jdbc:oceanbase://10.79.169.37:2881/meta_database?useUnicode=true&characterEncoding=UTF8&encloseParamInParentheses=false&connectTimeout=2000&socketTimeout=30000&rewriteBatchedStatements=true&zeroDateTimeBehavior=convertToNull 2024-12-31 18:18:19.068 INFO 34018 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : begin AfterDataSourceCreationHook 2024-12-31 18:18:19.068 INFO 34018 --- [main,,] c.o.o.b.spring.DataSourceInterceptor : end AfterDataSourceCreationHook 2024-12-31 18:18:19.930 INFO 34018 --- [main,,] o.hibernate.jpa.internal.util.LogHelper : HHH000204: Processing PersistenceUnitInfo [name: default] 2024-12-31 18:18:23.257 INFO 34018 --- [main,,] org.hibernate.dialect.Dialect : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect 2024-12-31 18:18:23.856 INFO 34018 --- [main,,] o.h.e.t.j.p.i.JtaPlatformInitiator : HHH000490: Using JtaPlatform implementation: [org.hibernate.engine.transaction.jta.platform.internal.NoJtaPlatform] 2024-12-31 18:18:23.858 INFO 34018 --- [main,,] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default' 2024-12-31 18:18:40.954 INFO 34018 --- [main,,] org.reflections.Reflections : Reflections took 6141 ms to scan 81 urls, producing 1062 keys and 7488 values 2024-12-31 18:18:47.169 INFO 34018 --- [main,,] org.reflections.Reflections : Reflections took 6116 ms to scan 81 urls, producing 1062 keys and 7488 values 2024-12-31 18:18:54.505 INFO 34018 --- [main,,] org.reflections.Reflections : Reflections took 7310 ms to scan 81 urls, producing 985 keys and 4895 values 2024-12-31 18:18:54.533 INFO 34018 --- [main,,] c.o.o.s.c.analyzer.OcpStartUpChecker : audit event is disable 2024-12-31 18:19:02.293 INFO 34018 --- [main,,] org.reflections.Reflections : Reflections took 7166 ms to scan 81 urls, producing 985 keys and 4895 values 2024-12-31 18:19:02.314 INFO 34018 --- [main,,] c.o.o.c.d.event.DistributedEventManager : [OCP116021] DistributedEventManager scanned event classes: [class com.oceanbase.ocp.core.mc.cache.RefreshOcpClusterCacheEvent, class com.oceanbase.ocp.core.distributed.event.NoContentDistributedEvent, class com.oceanbase.ocp.core.distributed.event.SimpleDistributedEvent, class com.oceanbase.ocp.core.configurl.event.RefreshClusterCacheEvent, class com.oceanbase.ocp.core.distributed.event.KeyValueDistributedEvent, class com.oceanbase.ocp.obops.cluster.event.InvalidateObVersionEvent, class com.oceanbase.ocp.service.obproxy.event.ResetAllProxyIdEvent, class com.oceanbase.ocp.obops.event.TenantRenamedDistributedEvent] 2024-12-31 18:19:02.315 INFO 34018 --- [main,,] c.o.o.c.d.event.DistributedEventManager : [OCP116025] DistributedEventManager construct event class class com.oceanbase.ocp.core.distributed.event.NoContentDistributedEvent failed, error: null 2024-12-31 18:19:02.315 INFO 34018 --- [main,,] c.o.o.c.d.event.DistributedEventManager : [OCP116025] DistributedEventManager construct event class class com.oceanbase.ocp.core.distributed.event.SimpleDistributedEvent failed, error: null 2024-12-31 18:19:02.316 INFO 34018 --- [main,,] c.o.o.c.d.event.DistributedEventManager : [OCP116025] DistributedEventManager construct event class class com.oceanbase.ocp.core.distributed.event.KeyValueDistributedEvent failed, error: null 2024-12-31 18:19:02.316 INFO 34018 --- [main,,] c.o.o.c.d.event.DistributedEventManager : [OCP116022] DistributedEventManager scanned event class map: {refresh ocp cluster cache=class com.oceanbase.ocp.core.mc.cache.RefreshOcpClusterCacheEvent, reset-all-obproxy-id=class com.oceanbase.ocp.service.obproxy.event.ResetAllProxyIdEvent, refresh-config-server-cache=class com.oceanbase.ocp.core.configurl.event.RefreshClusterCacheEvent, tenant-renamed=class com.oceanbase.ocp.obops.event.TenantRenamedDistributedEvent, invalidate-ob-version-cache=class com.oceanbase.ocp.obops.cluster.event.InvalidateObVersionEvent} 2024-12-31 18:19:02.342 INFO 34018 --- [main,,] c.o.o.c.d.event.DistributedEventManager : [OCP116001] DistributedEventManager started on a9efd8d51e 2024-12-31 18:19:02.520 INFO 34018 --- [main,,] com.oceanbase.ocp.core.util.BeanUtils : BeanUtils initialized 2024-12-31 18:19:05.548 INFO 34018 --- [main,,] c.o.o.a.c.AlarmConfigurationManager : defaultTimeZone not set, use system default, zoneId=Asia/Shanghai 2024-12-31 18:19:06.917 INFO 34018 --- [main,,] c.o.ocp.alarm.AlarmBeanConfiguration : scheduleEnabled=true 2024-12-31 18:19:06.986 INFO 34018 --- [main,,] c.o.o.a.s.OcpAlarmInitializeService : initialize global tasks done 2024-12-31 18:19:06.986 INFO 34018 --- [main,,] c.o.o.a.s.OcpAlarmInitializeService : initialize done 2024-12-31 18:19:08.227 INFO 34018 --- [main,,] c.o.o.alarm.core.silence.GlobalSilencer : enabled alarm types changed, previous=, current=ob_log_clog_write_error,ob_log_right_to_die,ob_host_net_send_percent_over_threshold,binlog_host_storage_usage_over_threshold,oblb_etcd_leader_absent,ob_tenant_compaction_error,ob_log_easy_hold_timeout,odp_instance_expanse_failed,binlog_host_cpu_usage_over_threshold,ob_log_decent_voting,ob_cluster_frozen_version_delta_over_threshold,binlog_node_status_abnormal,ob_log_commit_error,obproxy_memory_peak,host_operation,ob_log_mysql_request_full,ob_log_timer_cost_much,ob_log_worker_thread_full,host_disk_readonly,node_file_root_usage,rootservice_log_alarm,ob_log_disk_almost_full,obdns_etcd_cannot_connect_to_leader,oms_sync_failed,binlog_service_conversion_delay,ob_cluster_sync_delay_time_too_long,arbitration_service_unavailable,ob_cluster_merge_timeout,ob_common_unexpected_internal_error,partition_create_failed,ob_cluster_recyclebin_disk_used_over_threshold,ob_log_mem_alloc_error,ob_rootservice_stop_fail,base_backup_timeout,refresh_location_cache_failed,host_ntp_offset_too_large,ob_log_error_lib_direct_alloc,ob_host_invalid_disk_exists,ob_cluster_no_frozen,ocp_collect_metric_failure_rate_high,ob_log_distributed_strong_read,ob_tenant_cpu_usage_over_threshold,ob_log_fail_check_localserver,host_agent_open_fd_count_over_threshold,ob_cluster_sync_failed,oblb_ip_forward_invalid,backup_process_dead,oblb_keepalived_service_inactive,oblb_process_dead,ob_tenant500_storage_short_meta_mem_hold_high,ob_host_install_disk_percent_over_threshold,ob_tenant500_mem_hold_percent_over_threshold,odp_sql_execute_failed,binlog_instance_operation_info,obagent_dead,ob_server_stop_fail,ob_server_cannot_connect_arbitration,ob_log_rpc_error,ob_server_sstable_percent_over_threshold,oms_sync_delay,ob_host_monitordb_disconnected,oblb_keepalived_become_master,os_tsar_traffic_drop,ob_log_unit_migrate_error,ob_log_reply_memstore_failed,host_agent_version_not_same,ob_log_global_trans_version_delay,ob_tenant_partition_leader_absent,ob_cluster_operation_info,ob_cluster_merge_error,ob_tenant_name_mismatch,backup 2024-12-31 18:19:09.667 INFO 34018 --- [main,,] c.o.o.monitor.MonitorBeanConfiguration : Table switch time is 1735640001 2024-12-31 18:19:10.817 INFO 34018 --- [main,,] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2024-12-31 18:19:10.868 INFO 34018 --- [main,,] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2024-12-31 18:19:11.018 INFO 34018 --- [main,,] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2024-12-31 18:19:11.028 INFO 34018 --- [main,,] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2024-12-31 18:19:11.178 INFO 34018 --- [main,,] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2024-12-31 18:19:11.206 INFO 34018 --- [main,,] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2024-12-31 18:19:11.213 INFO 34018 --- [main,,] c.o.o.m.query.LocalMetricQueryService : Monitor router init, username=system, connectTimeoutMs=3000, readTimeoutMs=120000 2024-12-31 18:19:12.353 INFO 34018 --- [sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Consumer offline, id=1, heartbeatTime=2024-12-31T18:17:24+08:00, now=2024-12-31T18:19:12.352+08:00 2024-12-31 18:19:12.353 INFO 34018 --- [sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Consumer offline, id=2, heartbeatTime=2024-12-31T18:17:24+08:00, now=2024-12-31T18:19:12.352+08:00 2024-12-31 18:19:12.555 INFO 34018 --- [heartbeat-alarm-detect-by-rule-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Slice modified, module=alarm-detect-by-rule, name=10.79.169.37:8090, consumerId=2, resources=[ShardingSlice(consumerId=2, type=DEFAULT, resourceIds=[18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 80, 81, 106, 107, 249, 250, 251, 252, 253])] 2024-12-31 18:19:12.581 INFO 34018 --- [tag-manual-task-1,,] c.o.ocp.service.task.TaskTagService : Tag task instances start. 2024-12-31 18:19:12.613 INFO 34018 --- [tag-manual-task-1,,] c.o.ocp.service.task.TaskTagService : Tag task instances end. 2024-12-31 18:19:12.655 INFO 34018 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.print.sql = true 2024-12-31 18:19:12.656 INFO 34018 --- [main,,] c.o.ocp.obsdk.config.Configurations : [obsdk] set sqlLogEnabled=true 2024-12-31 18:19:12.659 INFO 34018 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.max-idle.seconds = 3600 2024-12-31 18:19:12.675 INFO 34018 --- [main,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] set maxIdleSeconds=3600 2024-12-31 18:19:12.678 INFO 34018 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.cleanup.period.seconds = 300 2024-12-31 18:19:12.678 INFO 34018 --- [main,,] c.o.ocp.obsdk.config.Configurations : [obsdk] set cleanPeriod=300 2024-12-31 18:19:12.681 INFO 34018 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.query.global.timeout.millis = 10000 2024-12-31 18:19:12.681 INFO 34018 --- [main,,] c.o.ocp.obsdk.config.Configurations : [obsdk] set queryGlobalTimeoutMillis=10000 2024-12-31 18:19:12.683 INFO 34018 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.operation.global.timeout.millis = 300000 2024-12-31 18:19:12.683 INFO 34018 --- [main,,] c.o.ocp.obsdk.config.Configurations : [obsdk] set ddlGlobalTimeoutMillis=300000 2024-12-31 18:19:12.685 INFO 34018 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.init.timeout.millis = 10000 2024-12-31 18:19:12.685 INFO 34018 --- [main,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] set initTimeoutMillis=10000 2024-12-31 18:19:12.687 INFO 34018 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.slow.query.threshold.millis = 1000 2024-12-31 18:19:12.687 INFO 34018 --- [main,,] c.o.ocp.obsdk.config.Configurations : [obsdk] set slowQueryThresholdMillis=1000 2024-12-31 18:19:12.689 INFO 34018 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.holder.capacity = 2000 2024-12-31 18:19:12.692 INFO 34018 --- [main,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] set cacheSize=2000 2024-12-31 18:19:12.694 INFO 34018 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.socket.read.timeout.millis = 1800000 2024-12-31 18:19:12.694 INFO 34018 --- [main,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] set socketReadTimeoutMillis=1800000 2024-12-31 18:19:12.697 INFO 34018 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.connector.init.executor.thread-count = 16 2024-12-31 18:19:12.697 INFO 34018 --- [main,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] set socketInitThreadCount=16 2024-12-31 18:19:12.699 INFO 34018 --- [main,,] c.o.o.s.ob.obsdk.config.ObSdkConfig : [ObSdkConfig] init, obsdk.socket.connect.timeout.millis = 2000 2024-12-31 18:19:12.699 INFO 34018 --- [main,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] set socketConnectTimeoutMillis=2000 2024-12-31 18:19:15.556 INFO 34018 --- [heartbeat-alarm-detect-by-target-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Modify consumer state, from OFFLINE to NEW. 2024-12-31 18:19:16.796 INFO 34018 --- [main,,] c.o.o.s.o.operator.LocalFileOperator : FileStorageService init, fileDirPath=/data2/ocp-home 2024-12-31 18:19:17.563 INFO 34018 --- [sharding-alarm-detect-by-rule1,,] c.o.o.core.sharding.ShardingCoordinator : Start rebalance, consumerSize=1, sliceEntitySize=1, strategy=com.oceanbase.ocp.alarm.sharding.AlarmDetectByRuleShardingStrategy@1e4a0cdf 2024-12-31 18:19:17.567 INFO 34018 --- [sharding-alarm-detect-by-rule1,,] c.o.o.c.sharding.registry.ShardingTask : Mark consumer state, newState=PAUSE 2024-12-31 18:19:17.577 INFO 34018 --- [sharding-alarm-detect-by-target1,,] c.o.o.core.sharding.ShardingCoordinator : Start rebalance, consumerSize=1, sliceEntitySize=0, strategy=com.oceanbase.ocp.alarm.sharding.AlarmDetectByTargetIdShardingStrategy@3a66672f 2024-12-31 18:19:17.579 INFO 34018 --- [sharding-alarm-detect-by-target1,,] c.o.o.c.sharding.registry.ShardingTask : Mark consumer state, newState=PAUSE 2024-12-31 18:19:18.497 INFO 34018 --- [main,,] c.o.o.s.common.config.BeanConfiguration : begin set auto discover false. 2024-12-31 18:19:18.501 INFO 34018 --- [main,,] c.o.o.s.common.config.BeanConfiguration : set auto discover false success. 2024-12-31 18:19:18.569 INFO 34018 --- [heartbeat-alarm-detect-by-rule-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2024-12-31 18:19:18.569 INFO 34018 --- [heartbeat-alarm-detect-by-target-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2024-12-31 18:19:18.603 INFO 34018 --- [sharding-alarm-detect-by-target1,,] c.o.o.c.sharding.registry.ShardingTask : Mark consumer state, newState=ASSIGNED 2024-12-31 18:19:18.644 INFO 34018 --- [heartbeat-alarm-detect-by-rule-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Slice modified, module=alarm-detect-by-rule, name=10.79.169.37:8090, consumerId=2, resources=[] 2024-12-31 18:19:18.697 INFO 34018 --- [sharding-alarm-detect-by-rule1,,] c.o.o.c.sharding.registry.ShardingTask : Mark consumer state, newState=ASSIGNED 2024-12-31 18:19:21.645 INFO 34018 --- [heartbeat-alarm-detect-by-target-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2024-12-31 18:19:21.645 INFO 34018 --- [heartbeat-alarm-detect-by-target-10.79.169.37:80901,,] c.o.o.alarm.AlarmShardingConfiguration : Consumer had rebalanced. 2024-12-31 18:19:21.647 INFO 34018 --- [heartbeat-alarm-detect-by-rule-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2024-12-31 18:19:21.647 INFO 34018 --- [heartbeat-alarm-detect-by-rule-10.79.169.37:80901,,] c.o.o.alarm.AlarmShardingConfiguration : Consumer had rebalanced. 2024-12-31 18:19:21.653 INFO 34018 --- [heartbeat-alarm-detect-by-rule-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Slice modified, module=alarm-detect-by-rule, name=10.79.169.37:8090, consumerId=2, resources=[ShardingSlice(consumerId=2, type=DEFAULT, resourceIds=[18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 80, 81, 106, 107, 249, 250, 251, 252, 253])] 2024-12-31 18:19:22.915 INFO 34018 --- [main,,] c.o.o.alarm.schedule.AlarmScheduledJobs : AlarmSchedules construct done 2024-12-31 18:19:23.652 INFO 34018 --- [main,,] c.o.o.a.c.d.MessageDistributorFactory : build alarmSubscribedJudger, currentSubscribedJudgerVersion subscription-0-2024-12-31T18:19:22.984+08:00_groups-11-2024-12-31T18:12:40+08:00-2024-12-31T18:12:40+08:00_detectRules-536-2024-12-31T10:12:44.838876Z_readableClusters_2_system- admin-, subscribedJudgerVersion 2024-12-31 18:19:23.658 INFO 34018 --- [main,,] c.o.o.a.c.distribute.DistributeBuilder : buildSubscribedJudger, usersSubscribedCount=0, userEnableReceiveCount=0 2024-12-31 18:19:23.658 INFO 34018 --- [main,,] c.o.o.a.c.d.MessageDistributorFactory : build recoverSubscribedJudger, currentSubscribedJudgerVersion subscription-0-2024-12-31T18:19:22.984+08:00_groups-11-2024-12-31T18:12:40+08:00-2024-12-31T18:12:40+08:00_detectRules-536-2024-12-31T10:12:44.838876Z_readableClusters_2_system- admin-, subscribedJudgerVersion 2024-12-31 18:19:23.659 INFO 34018 --- [main,,] c.o.o.a.c.distribute.DistributeBuilder : buildRecoverMessageSubscribedJudger, usersSubscribedCount=0, userEnableReceiveCount=0 2024-12-31 18:19:23.660 INFO 34018 --- [main,,] c.o.o.a.c.d.MessageDistributorFactory : buildAllDistributors 2024-12-31 18:19:23.717 INFO 34018 --- [main,,] c.o.o.a.c.n.NotificationSender : NotificationSender init, scriptDirectoryPath=/home/admin/ocp-server/alarm 2024-12-31 18:19:24.018 INFO 34018 --- [main,,] c.o.ocp.alarm.AlarmBeanConfiguration : initialize alarmTaskExecutor 2024-12-31 18:19:24.071 INFO 34018 --- [main,,] c.o.o.alarm.utils.task.AlarmTaskManager : alarm task manager construct done, executorName=10.79.169.37:34018 2024-12-31 18:19:24.183 INFO 34018 --- [main,,] c.o.o.a.c.d.metrics.AlarmMetricsQuery : createMetricMetaMapping done, metasCount=169 2024-12-31 18:19:24.238 INFO 34018 --- [main,,] c.o.o.a.c.d.metrics.SqlMetricsQuery : createMetricMetaMapping done, metasCount=169 2024-12-31 18:19:24.257 INFO 34018 --- [main,,] c.o.ocp.alarm.AlarmBeanConfiguration : initialize alarmDetectMetricExecutor 2024-12-31 18:19:24.305 INFO 34018 --- [main,,] c.o.ocp.alarm.core.task.AlarmDetectTask : AlarmDetectTask created 2024-12-31 18:19:24.656 INFO 34018 --- [main,,] c.o.o.c.d.s.DistributedServiceManager : DistributedService updater scheduler started on 10.79.169.37:8090 2024-12-31 18:19:24.666 INFO 34018 --- [main,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Init, apiConnectTimeoutMillis:1000, apiReadTimeoutMillis:1000, taskSchedulePeriodSec:3 2024-12-31 18:19:24.717 WARN 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error state, the follower found itself leader. 2024-12-31 18:19:24.717 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-12-31 18:19:27.034 INFO 34018 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_config_template.yaml in jar 2024-12-31 18:19:27.071 INFO 34018 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_ob_relations_config.yaml in jar 2024-12-31 18:19:27.094 INFO 34018 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_ability_ob_version_relation_config.yaml in jar 2024-12-31 18:19:27.103 INFO 34018 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from physical_backup_ability_ob_version_relation_config.yaml in jar 2024-12-31 18:19:27.718 WARN 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : Error state, the follower found itself leader. 2024-12-31 18:19:27.719 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : After refresh, the leader address is :null 2024-12-31 18:19:28.438 INFO 34018 --- [main,,] c.o.o.c.t.engine.util.ThreadPrintStream : replaceSystemOut done 2024-12-31 18:19:28.490 INFO 34018 --- [main,,] c.o.o.s.c.analyzer.SslTrustInitializer : ssl not enabled, do nothing 2024-12-31 18:19:29.670 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=CMDB_SYNCER, serverId=10.79.169.37:8090, expireInSeconds=30, createTime=2024-12-31T18:15:37+08:00, updateTime=2024-12-31T18:17:17+08:00, expireTime=null, isLeader=false} 2024-12-31 18:19:29.673 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=MC_MANAGER, serverId=10.79.169.37:8090, expireInSeconds=30, createTime=2024-12-31T18:15:37+08:00, updateTime=2024-12-31T18:17:17+08:00, expireTime=null, isLeader=false} 2024-12-31 18:19:29.675 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PERF_SQL_ROLLUP, serverId=10.79.169.37:8090, expireInSeconds=30, createTime=2024-12-31T18:15:37+08:00, updateTime=2024-12-31T18:17:22+08:00, expireTime=null, isLeader=false} 2024-12-31 18:19:29.678 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=PLAN_CHANGE_DETECTOR, serverId=10.79.169.37:8090, expireInSeconds=30, createTime=2024-12-31T18:15:37+08:00, updateTime=2024-12-31T18:17:07+08:00, expireTime=null, isLeader=false} 2024-12-31 18:19:29.680 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=RATE_LIMIT, serverId=10.79.169.37:8090, expireInSeconds=30, createTime=2024-12-31T18:15:37+08:00, updateTime=2024-12-31T18:17:17+08:00, expireTime=null, isLeader=false} 2024-12-31 18:19:29.682 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_INDEX_DIAGNOSER, serverId=10.79.169.37:8090, expireInSeconds=30, createTime=2024-12-31T18:15:37+08:00, updateTime=2024-12-31T18:17:07+08:00, expireTime=null, isLeader=false} 2024-12-31 18:19:29.685 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=SQL_PERF_DIAGNOSER, serverId=10.79.169.37:8090, expireInSeconds=30, createTime=2024-12-31T18:15:37+08:00, updateTime=2024-12-31T18:17:07+08:00, expireTime=null, isLeader=false} 2024-12-31 18:19:29.687 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : Deleted expired service: DistributedService{name=TASK_MANAGER, serverId=10.79.169.37:8090, expireInSeconds=30, createTime=2024-12-31T18:15:37+08:00, updateTime=2024-12-31T18:17:17+08:00, expireTime=null, isLeader=false} 2024-12-31 18:19:29.690 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_INDEX_DIAGNOSER, Incorrect result size: expected 1, actual 0 2024-12-31 18:19:29.696 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service MC_MANAGER, Incorrect result size: expected 1, actual 0 2024-12-31 18:19:29.701 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PERF_SQL_ROLLUP, Incorrect result size: expected 1, actual 0 2024-12-31 18:19:29.706 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service CMDB_SYNCER, Incorrect result size: expected 1, actual 0 2024-12-31 18:19:29.711 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service TASK_MANAGER, Incorrect result size: expected 1, actual 0 2024-12-31 18:19:29.716 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service RATE_LIMIT, Incorrect result size: expected 1, actual 0 2024-12-31 18:19:29.721 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service PLAN_CHANGE_DETECTOR, Incorrect result size: expected 1, actual 0 2024-12-31 18:19:29.725 WARN 34018 --- [ocp-updater-0,,] c.o.o.c.d.service.DefaultServiceUpdater : No leader or more than one leader exists for service SQL_PERF_DIAGNOSER, Incorrect result size: expected 1, actual 0 2024-12-31 18:19:29.785 INFO 34018 --- [main,,] c.o.o.s.c.c.s.u.SensitiveDataDecryptor : Validate and set keys, publicKey=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC4RG0d4r/p1eGjCZdy5fsVy1p2XSAATOFPv/XgcWlRRTb7Z+M+WxoSjwqNllEJuKXpoVnWdcDnjtR61lwMy+yS5mrxHN+vUh2ssZNuVXEQ3VXBn2AB6DbJp5xMcHYRbyAe5P866kCUaSRaoG1WTGbXRVOizbKwmkA1EYXDgj9sGwIDAQAB, valid=true 2024-12-31 18:19:29.785 INFO 34018 --- [main,,] c.o.o.s.c.c.s.u.SensitiveDataDecryptor : Sensitive data encryption key is legal. 2024-12-31 18:19:29.863 INFO 34018 --- [main,,] c.o.o.a.c.AlarmConfiguration : alarm configuration set from system properties 2024-12-31 18:19:30.719 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 gets the leadership... 2024-12-31 18:19:30.841 INFO 34018 --- [main,,] c.o.o.m.promethues.InnerMetricContainer : init inner metric container success, configToMetricMap = {InnerMetricContainer.InnerMetricConfig(scrapeType=second)=[system_cpu_count, jvm_threads_states_threads, jvm_gc_memory_promoted_bytes_total, jvm_memory_committed_bytes, ocp_monitor_collect_request_errors_total, ocp_meta_db_health, jvm_gc_pause_seconds_max, ocp_monitor_collect_request_duration_ms_count, system_cpu_usage, process_threads, http_server_requests_seconds_count, jvm_gc_memory_allocated_bytes_total, jvm_threads_peak_threads, ocp_alarm_detect_duration_ms_count, jvm_memory_used_bytes, process_cpu_usage, jvm_memory_max_bytes, jvm_gc_max_data_size_bytes, http_server_requests_seconds_sum, jvm_gc_pause_seconds_sum, ocp_alarm_detect_duration_ms_sum, jvm_threads_live_threads, system_load_average_1m, jvm_gc_pause_seconds_count, jvm_gc_overhead_percent]} 2024-12-31 18:19:30.856 INFO 34018 --- [main,,] c.o.o.s.c.config.MetricConfiguration : Monitor sharding strategy is monitor 2024-12-31 18:19:31.652 INFO 34018 --- [main,,] .o.o.o.i.c.ClusterSystemEventServiceImpl : Init eventTemplateCache: 172 cache entries, 172 elements. 2024-12-31 18:19:32.816 INFO 34018 --- [main,,] c.o.o.s.c.BuiltInFilesInitializeLoader : Load lib files, localBuiltInDir=/data2/ocp-home/ocp/ocp-server/lib 2024-12-31 18:19:32.816 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : Remove built-in file:obproxyd.sh 2024-12-31 18:19:32.863 INFO 34018 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Delete object, bucket=built-in, name=obproxyd.sh, objectId=1 2024-12-31 18:19:32.938 INFO 34018 --- [main,,] c.o.o.s.o.operator.ObjectBlockOperator : deleteByFileId, deletedBlockCount=1 2024-12-31 18:19:32.980 INFO 34018 --- [main,,] c.o.o.s.o.operator.LocalFileOperator : delete local file, absolutePathName=/data2/ocp-home/built-in/obproxyd.sh.sha1sum 2024-12-31 18:19:32.981 INFO 34018 --- [main,,] c.o.o.s.o.operator.LocalFileOperator : delete local file, absolutePathName=/data2/ocp-home/built-in/obproxyd.sh 2024-12-31 18:19:32.981 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : Load built-in file:obproxyd.sh 2024-12-31 18:19:33.028 INFO 34018 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Init saving object, creatorId=200, bucket=built-in, name=obproxyd.sh, objectId=8 2024-12-31 18:19:33.061 INFO 34018 --- [main,,] .o.o.s.o.i.LocalObjectStorageServiceImpl : Finish saving object, objectId=8, name=obproxyd.sh 2024-12-31 18:19:33.075 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : packageName:ocp-agent-ce-4.3.2-20241012145836.el7.aarch64.rpm 2024-12-31 18:19:33.104 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : Software package already exist, name=ocp-agent-ce-4.3.2-20241012145836.el7.aarch64.rpm 2024-12-31 18:19:33.104 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : packageName:ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm 2024-12-31 18:19:33.112 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : Software package already exist, name=ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm 2024-12-31 18:19:33.112 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : packageName:oceanbase-ce-utils-4.2.1.10-110000072024112010.el7.x86_64.rpm 2024-12-31 18:19:33.117 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : Software package already exist, name=oceanbase-ce-utils-4.2.1.10-110000072024112010.el7.x86_64.rpm 2024-12-31 18:19:33.117 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : packageName:oceanbase-ce-4.2.1.10-110000072024112010.el7.x86_64.rpm 2024-12-31 18:19:33.125 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : Software package already exist, name=oceanbase-ce-4.2.1.10-110000072024112010.el7.x86_64.rpm 2024-12-31 18:19:33.125 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : packageName:oceanbase-ce-libs-4.2.1.10-110000072024112010.el7.x86_64.rpm 2024-12-31 18:19:33.130 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : Software package already exist, name=oceanbase-ce-libs-4.2.1.10-110000072024112010.el7.x86_64.rpm 2024-12-31 18:19:33.130 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : packageName:obproxy-ce-4.3.2.0-26.el7.x86_64.rpm 2024-12-31 18:19:33.135 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : Software package already exist, name=obproxy-ce-4.3.2.0-26.el7.x86_64.rpm 2024-12-31 18:19:33.137 INFO 34018 --- [main,,] c.o.o.s.s.b.BuiltInFileServiceImpl : Save matched ocp-agent version, version=4.3.2-20241012145836 2024-12-31 18:19:33.146 INFO 34018 --- [main,,] c.o.ocp.core.property.PropertyService : Inner update property, key=ocp.agent.version.full, previousValue=4.3.2-20241012145836, updatedValue=4.3.2-20241012145836, runningValue=4.3.2-20241012145836 2024-12-31 18:19:33.338 INFO 34018 --- [main,,] c.o.o.s.dataclean.TableCleaningService : Successfully init all table cleaning configurations: {"cleanDistributedEvent":{"batchIntervalMillis":0,"batchSize":0,"condition":"expire_time <= date_sub(curdate(), interval 30 day)","priority":1,"tableName":"distributed_event"},"cleanDistributedEventReception":{"batchIntervalMillis":0,"batchSize":0,"condition":"event_id in (select id from distributed_event where expire_time <= date_sub(curdate(), interval 30 day))","priority":0,"tableName":"distributed_event_reception"},"cleanStatusTransition":{"batchIntervalMillis":0,"batchSize":0,"condition":"expire_time <= date_sub(curdate(), interval 30 day)","priority":0,"tableName":"ops_status_transition"}} 2024-12-31 18:19:33.719 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:19:33.728 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:19:33.918 INFO 34018 --- [main,,] f.a.AutowiredAnnotationBeanPostProcessor : Autowired annotation is not supported on static methods: public static void com.oceanbase.ocp.core.util.jpa.JsonNodeConverter.init(com.fasterxml.jackson.databind.ObjectMapper) 2024-12-31 18:19:34.161 INFO 34018 --- [main,,] s.i.c.SqlAuditRawStatRollupDaemonService : SQL stat rollup daemon submitted 2024-12-31 18:19:34.164 INFO 34018 --- [main,,] s.i.c.SqlAuditRawStatRollupDaemonService : SQL stat rollup workers submitted 2024-12-31 18:19:35.884 INFO 34018 --- [sharding-metric-collect1,,] c.o.o.core.sharding.ShardingCoordinator : Start rebalance, consumerSize=1, sliceEntitySize=0, strategy=com.oceanbase.ocp.monitor.sharding.MonitorShardingStrategy@61c55d0d 2024-12-31 18:19:35.886 INFO 34018 --- [sharding-metric-collect1,,] c.o.o.c.sharding.registry.ShardingTask : Mark consumer state, newState=PAUSE 2024-12-31 18:19:36.468 INFO 34018 --- [main,,] c.o.ocp.ha.maz.OcpAzoneDaemonService : Multi azone daemon not enabled 2024-12-31 18:19:36.566 INFO 34018 --- [main,,] c.o.ocp.monitor.OcpMonitorManager : OcpMonitorManager init start... 2024-12-31 18:19:36.568 INFO 34018 --- [main,,] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640400, interval=60 2024-12-31 18:19:36.568 INFO 34018 --- [main,,] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:19:36.570 INFO 34018 --- [main,,] c.o.ocp.monitor.OcpMonitorManager : OcpMonitorManager init success. 2024-12-31 18:19:36.655 INFO 34018 --- [main,,] c.o.o.m.c.MonitorDataRolloverProperties : Monitor retention conf is {ob_cluster_system_event=31, ob_cluster_server_event=31, ocp_metric_data_1=8, ocp_metric_data_60=31, metric_data_async=1, metric_hour_data=1098, metric_daily_data=1098} 2024-12-31 18:19:36.728 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:19:36.730 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:19:36.963 INFO 34018 --- [main,,] .r.DefaultUserResourceManagerServiceImpl : not UPGRADE, skip create default user resource 2024-12-31 18:19:37.387 INFO 34018 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_config_template.yaml in jar 2024-12-31 18:19:37.395 INFO 34018 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_agent_ob_relations_config.yaml in jar 2024-12-31 18:19:37.398 INFO 34018 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from backup_ability_ob_version_relation_config.yaml in jar 2024-12-31 18:19:37.398 INFO 34018 --- [main,,] c.o.o.b.i.c.BackupDataConfiguration : read from physical_backup_ability_ob_version_relation_config.yaml in jar 2024-12-31 18:19:37.399 INFO 34018 --- [main,,] c.o.o.b.i.c.BackupConfiguration : init backup agent meta cfg 2024-12-31 18:19:37.421 INFO 34018 --- [main,,] c.o.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key global_lock_com.oceanbase.ocp.backup.internal.task.backupocptaskmanager 2024-12-31 18:19:37.427 INFO 34018 --- [main,,] c.o.o.b.i.a.BackupRestoreAgentService : upgradeFromOldAgentToNewService start. 2024-12-31 18:19:37.486 INFO 34018 --- [main,,] c.o.o.b.i.a.BackupRestoreAgentService : serviceInfos=[], allMachineList=[] 2024-12-31 18:19:37.501 INFO 34018 --- [main,,] c.o.o.b.i.task.BackupOcpTaskManager : register backup schedules success 2024-12-31 18:19:37.990 INFO 34018 --- [main,,] c.o.ocp.alarm.AlarmBeanConfiguration : initialize notificationSendExecutor 2024-12-31 18:19:38.704 INFO 34018 --- [main,,] .s.c.c.s.c.OcpSecurityConfiguratorHelper : Configure session, policy=STATELESS. 2024-12-31 18:19:38.723 INFO 34018 --- [main,,] s.c.c.s.c.StatelessSecurityConfiguration : Internal auth configured. 2024-12-31 18:19:38.725 INFO 34018 --- [main,,] s.c.c.s.c.StatelessSecurityConfiguration : Access key auth configured. 2024-12-31 18:19:38.729 INFO 34018 --- [main,,] s.c.c.s.c.StatelessSecurityConfiguration : Basic auth enabled. 2024-12-31 18:19:38.903 INFO 34018 --- [heartbeat-metric-collect-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Modify consumer state, from PAUSE to WAITING. 2024-12-31 18:19:38.930 INFO 34018 --- [sharding-metric-collect1,,] c.o.o.c.sharding.registry.ShardingTask : Mark consumer state, newState=ASSIGNED 2024-12-31 18:19:39.202 INFO 34018 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will secure com.oceanbase.ocp.server.common.config.security.conf.StatelessSecurityConfiguration$$Lambda$2049/2037901313@17ac1104 with [org.springframework.security.web.session.DisableEncodeUrlFilter@69d7c457, org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@373b2f60, org.springframework.security.web.context.SecurityContextPersistenceFilter@257e021, org.springframework.security.web.header.HeaderWriterFilter@38d75769, org.springframework.security.web.authentication.logout.LogoutFilter@2b9b907e, com.oceanbase.ocp.server.common.config.security.accesskey.ContentCacheRequestFilter@21e5a4ee, com.oceanbase.ocp.server.common.config.security.filter.InternalAuthenticationFilter@5636b5e7, com.oceanbase.ocp.server.common.config.security.accesskey.AccessKeyAuthenticationFilter@114260a, com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter@6fba4967, org.springframework.security.web.authentication.www.BasicAuthenticationFilter@2ed4c226, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@4f37d656, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@7e04d4f4, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@637442aa, org.springframework.security.web.session.SessionManagementFilter@6282be52, org.springframework.security.web.access.ExceptionTranslationFilter@5d7dd44d, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@398db059] 2024-12-31 18:19:39.579 INFO 34018 --- [main,,] o.o.core.config.InitializationService : Initializing OpenSAML using the Java Services API 2024-12-31 18:19:39.730 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:19:39.731 INFO 34018 --- [main,,] o.o.xmlsec.algorithm.AlgorithmRegistry : Algorithm failed runtime support check, will not be usable: http://www.w3.org/2001/04/xmlenc#ripemd160 2024-12-31 18:19:39.732 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:19:39.738 INFO 34018 --- [main,,] o.o.xmlsec.algorithm.AlgorithmRegistry : Algorithm failed runtime support check, will not be usable: http://www.w3.org/2001/04/xmldsig-more#hmac-ripemd160 2024-12-31 18:19:39.752 INFO 34018 --- [main,,] o.o.xmlsec.algorithm.AlgorithmRegistry : Algorithm failed runtime support check, will not be usable: http://www.w3.org/2001/04/xmldsig-more#rsa-ripemd160 2024-12-31 18:19:40.968 INFO 34018 --- [main,,] .s.c.c.s.c.OcpSecurityConfiguratorHelper : Configure session, policy=IF_REQUIRED. 2024-12-31 18:19:40.970 INFO 34018 --- [main,,] .s.c.c.s.c.OcpSecurityConfiguratorHelper : CSRF configured. 2024-12-31 18:19:41.297 INFO 34018 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will secure any request with [org.springframework.security.web.session.DisableEncodeUrlFilter@14df00d1, org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@63f51ba5, org.springframework.security.web.context.SecurityContextPersistenceFilter@3121fe16, org.springframework.security.web.header.HeaderWriterFilter@74981ca4, org.springframework.security.web.csrf.CsrfFilter@4a167641, org.springframework.security.web.authentication.logout.LogoutFilter@6af6a2ce, org.springframework.security.oauth2.client.web.OAuth2AuthorizationRequestRedirectFilter@2df57526, org.springframework.security.saml2.provider.service.servlet.filter.Saml2WebSsoAuthenticationRequestFilter@8773b9f, com.oceanbase.ocp.server.common.config.security.filter.TestLoginAuthenticationFilter@453c881, org.springframework.security.oauth2.client.web.OAuth2LoginAuthenticationFilter@3010c0fa, org.springframework.security.saml2.provider.service.servlet.filter.Saml2WebSsoAuthenticationFilter@5ab7bec4, com.oceanbase.ocp.server.common.config.security.filter.PreAuthenticationFilter@21803349, com.oceanbase.ocp.server.common.config.security.filter.PreUsernamePasswordAuthenticationFilter@4db56620, org.springframework.security.web.authentication.UsernamePasswordAuthenticationFilter@720b095a, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@43f66d94, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@773f2472, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@6566400, org.springframework.security.web.session.SessionManagementFilter@dc5c808, org.springframework.security.web.access.ExceptionTranslationFilter@7ea18096, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@312c9665] 2024-12-31 18:19:41.453 INFO 34018 --- [main,,] c.o.o.s.c.config.SpringScheduleConfig : Spring scheduled pool size is 30. 2024-12-31 18:19:41.478 INFO 34018 --- [main,,] c.o.o.b.i.m.s.StorageExporterServiceImpl : storage exporter register: collectEnable=true, periodMinutes=180 2024-12-31 18:19:41.478 INFO 34018 --- [main,,] c.o.o.b.i.m.s.StorageExporterServiceImpl : register backup exporter, periodMinutes=180 2024-12-31 18:19:41.842 INFO 34018 --- [main,,] c.o.o.s.o.s.c.OverviewBeanConfiguration : initialize overviewContainerExecutor 2024-12-31 18:19:41.936 INFO 34018 --- [heartbeat-metric-collect-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Modify consumer state, from ASSIGNED to WORKING. 2024-12-31 18:19:41.936 INFO 34018 --- [heartbeat-metric-collect-10.79.169.37:80901,,] c.o.o.s.c.config.MetricConfiguration : Consumer had rebalanced. 2024-12-31 18:19:42.165 WARN 34018 --- [main,,] JpaBaseConfiguration$JpaWebConfiguration : spring.jpa.open-in-view is enabled by default. Therefore, database queries may be performed during view rendering. Explicitly configure spring.jpa.open-in-view to disable this warning 2024-12-31 18:19:42.732 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:19:42.735 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:19:43.058 INFO 34018 --- [main,,] o.s.b.a.w.s.WelcomePageHandlerMapping : Adding welcome page: class path resource [static/index.html] 2024-12-31 18:19:45.735 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:19:45.800 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:19:47.013 WARN 34018 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/assets/**']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:19:47.013 INFO 34018 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/assets/**'] 2024-12-31 18:19:47.013 WARN 34018 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/index.html']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:19:47.013 INFO 34018 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/index.html'] 2024-12-31 18:19:47.013 WARN 34018 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/**/*.js']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:19:47.013 INFO 34018 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/**/*.js'] 2024-12-31 18:19:47.013 WARN 34018 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/**/*.css']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:19:47.013 INFO 34018 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/**/*.css'] 2024-12-31 18:19:47.013 WARN 34018 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/webjars/**']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:19:47.013 INFO 34018 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/webjars/**'] 2024-12-31 18:19:47.013 WARN 34018 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/**/*.svg']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:19:47.013 INFO 34018 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/**/*.svg'] 2024-12-31 18:19:47.013 WARN 34018 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/login']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:19:47.013 INFO 34018 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/login'] 2024-12-31 18:19:47.013 WARN 34018 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/docs/**']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:19:47.013 INFO 34018 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/docs/**'] 2024-12-31 18:19:47.014 WARN 34018 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/favicon.ico']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:19:47.014 INFO 34018 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/favicon.ico'] 2024-12-31 18:19:47.014 WARN 34018 --- [main,,] o.s.s.c.a.web.builders.WebSecurity : You are asking Spring Security to ignore Ant [pattern='/pre_login_loading']. This is not recommended -- please use permitAll via HttpSecurity#authorizeHttpRequests instead. 2024-12-31 18:19:47.014 INFO 34018 --- [main,,] o.s.s.web.DefaultSecurityFilterChain : Will not secure Ant [pattern='/pre_login_loading'] 2024-12-31 18:19:47.840 INFO 34018 --- [main,,] o.s.b.a.e.web.EndpointLinksResolver : Exposing 2 endpoint(s) beneath base path '/actuator' 2024-12-31 18:19:48.171 INFO 34018 --- [main,,] o.s.b.w.embedded.tomcat.TomcatWebServer : Tomcat started on port(s): 8090 (http) with context path '' 2024-12-31 18:19:48.422 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Ocp scheduled task specified config name, methodName=collectHighRiskSqlAuditStat, configName=collectHighSqlAuditStat 2024-12-31 18:19:48.422 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=4 2024-12-31 18:19:48.422 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectTransStatForAlarm, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.422 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectHighRiskSqlAuditStat, conf=ScheduledConf{initialDelay=120, cron='null', fixedDelay=300, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.422 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=oasSqlCuring, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.422 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectSlowSqlForAlarm, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.422 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=2 2024-12-31 18:19:48.422 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=syncBinlogClusters, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=30, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.422 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=syncBinlogInstances, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.422 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=14 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=alarmDetectOnce, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=10, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshDetectorFactory, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshGlobalSilencer, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=10, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshActiveAlarmStatus, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=resolveAlarmsOfAbsentTargets, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshBackupAlarmStat, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=180, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshAlarmSummary, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshAggregators, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=10, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshHostAlarmInfo, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=600, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=removeInactiveAlarmEvents, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=600, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=fixAlarmTarget, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshAlarmInMemory, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshAlarmTaskManager, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=20, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshAlarmTargets, conf=ScheduledConf{initialDelay=60, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.common.scheduled.OcpSchedules : Ocp multi cluster mode disabled. 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.common.scheduled.OcpSchedules : Ocp vpd mode disabled. 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=8 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=partitionDaemon, conf=ScheduledConf{initialDelay=120, cron='null', fixedDelay=600, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=cleanTaskRecords, conf=ScheduledConf{initialDelay=0, cron='0 20 5 * * *', fixedDelay=0, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkOdpClient, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectOdpMetrics, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshOcpConfig, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=180, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=cleanTaskLog, conf=ScheduledConf{initialDelay=0, cron='0 10 3 * * *', fixedDelay=0, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=cleanTmpLogFiles, conf=ScheduledConf{initialDelay=0, cron='0 20 4 * * *', fixedDelay=0, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=cleanupDruidCache, conf=ScheduledConf{initialDelay=600, cron='null', fixedDelay=300, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=7 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkHostStatus, conf=ScheduledConf{initialDelay=120, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkHostAgentStatus, conf=ScheduledConf{initialDelay=120, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=refreshAgentConfig, conf=ScheduledConf{initialDelay=2, cron='null', fixedDelay=10, fixedRate=0, timeUnit=MINUTES, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=getHostAgentAlarms, conf=ScheduledConf{initialDelay=2, cron='null', fixedDelay=1, fixedRate=0, timeUnit=MINUTES, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkHostVersion, conf=ScheduledConf{initialDelay=30, cron='null', fixedDelay=4, fixedRate=0, timeUnit=MINUTES, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkHostClockDiff, conf=ScheduledConf{initialDelay=120, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkCpuBindCore, conf=ScheduledConf{initialDelay=120, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=2 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkObproxyServers, conf=ScheduledConf{initialDelay=120, cron='10/30 * * * * *', fixedDelay=0, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.423 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectObproxyMetrics, conf=ScheduledConf{initialDelay=120, cron='10/30 * * * * *', fixedDelay=0, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=8 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkClusterStatus, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkStandbyClusterInfo, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=syncClusterInfo, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=syncRootServer, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=120, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=syncClusterSystemEvent, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=600, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectAllClusterCompaction, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkAllArbitrationService, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkClusterRootServer, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=0, fixedRate=300, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Scheduled tasks size=5 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=syncAllTenantInfo, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkAllStandbyTenant, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=0, fixedRate=30, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectAllTenantMajorCompaction, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=collectAllTenantMiniCompaction, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=300, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.424 INFO 34018 --- [main,,] c.o.o.s.c.scheduled.AbstractSchedules : Add scheduled task, name=checkAllTenantServiceNameConflict, conf=ScheduledConf{initialDelay=0, cron='null', fixedDelay=60, fixedRate=0, timeUnit=SECONDS, enabled=true} 2024-12-31 18:19:48.458 INFO 34018 --- [ocp-schedules-1,c318851e39b41c35,6175770d4b869fcc] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:19:48.458 INFO 34018 --- [ocp-schedules-4,8100cc2438881628,fc4533be24178cac] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:19:48.458 INFO 34018 --- [ocp-schedules-17,40183c49aea5e717,742237faf8811c18] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:19:48.461 INFO 34018 --- [ocp-schedules-15,8b4ddef1f354d5ab,9cb842297ffa9aff] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:19:48.461 INFO 34018 --- [ocp-schedules-6,93795a0e44b87f52,be5ce225f68fc89a] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:19:48.467 ERROR 34018 --- [ocp-schedules-6,93795a0e44b87f52,be5ce225f68fc89a] com.alibaba.druid.pool.DruidDataSource : testWhileIdle is true, validationQuery not set 2024-12-31 18:19:48.471 INFO 34018 --- [ocp-schedules-6,93795a0e44b87f52,be5ce225f68fc89a] com.alibaba.druid.pool.DruidDataSource : {dataSource-2} inited 2024-12-31 18:19:48.471 INFO 34018 --- [ocp-schedules-16,aa204b6f57fd6eed,fac10b3d2a611749] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:19:48.476 INFO 34018 --- [ocp-schedules-24,31eaa2cd1ea9fb03,de7038c3a680e5d7] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:19:48.479 INFO 34018 --- [ocp-schedules-26,614550017dcf86df,8a6f184440e8ddc4] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper 2024-12-31 18:19:48.476 INFO 34018 --- [ocp-schedules-24,31eaa2cd1ea9fb03,de7038c3a680e5d7] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:19:48.480 INFO 34018 --- [ocp-schedules-3,bd7a4eb20e6695fb,f1d260757b63b5df] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:19:48.486 INFO 34018 --- [ocp-schedules-7,fa4c5831dfc2ef46,8fbf733a610774bf] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:19:48.486 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2024-12-31 18:19:48.486 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.ocp.core.property.PropertyService : Refresh config properties 2024-12-31 18:19:48.488 ERROR 34018 --- [ocp-schedules-1,c318851e39b41c35,6175770d4b869fcc] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task java.lang.RuntimeException: java.lang.reflect.InvocationTargetException at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:79) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) ... 10 common frames omitted Caused by: java.lang.NullPointerException: null at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.adaptTimeout(AbstractSchedules.java:47) at com.oceanbase.ocp.server.common.scheduled.ClusterSchedules.syncClusterInfo(ClusterSchedules.java:77) ... 15 common frames omitted 2024-12-31 18:19:48.489 INFO 34018 --- [ocp-schedules-1,74594837e9794935,92857bc47a4de395] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2024-12-31 18:19:48.489 INFO 34018 --- [ocp-schedules-30,ee80258312d19601,aa00e5a7c1d14d62] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster system event. 2024-12-31 18:19:48.489 INFO 34018 --- [ocp-schedules-8,1c6d6f14752fe256,94d9e7185d4931c0] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster root server. 2024-12-31 18:19:48.490 INFO 34018 --- [ocp-schedules-19,d428fa7866eef62b,f199bd5d04312ff3] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:19:48.494 INFO 34018 --- [ocp-schedules-22,764573bd695df384,a5948ba0cca903fa] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant mini compaction 2024-12-31 18:19:48.497 INFO 34018 --- [ocp-schedules-10,265646534be3ceae,3026af2711d95fbc] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:19:48.497 INFO 34018 --- [ocp-schedules-18,094866fc6d1ac64f,269575990fae5b00] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:19:48.498 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ************************* ACTIVE OCP PROPERTIES ****************************** 2024-12-31 18:19:48.499 INFO 34018 --- [ocp-schedules-14,e6e981d631dc20d0,96085e4e2f93cbb5] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:19:48.499 INFO 34018 --- [ocp-schedules-10,265646534be3ceae,3026af2711d95fbc] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:19:48.501 ERROR 34018 --- [ocp-schedules-18,094866fc6d1ac64f,269575990fae5b00] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task java.lang.RuntimeException: java.lang.reflect.InvocationTargetException at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:79) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) ... 10 common frames omitted Caused by: java.lang.NullPointerException: null at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.adaptTimeout(AbstractSchedules.java:47) at com.oceanbase.ocp.server.common.scheduled.TenantSchedules.syncAllTenantInfo(TenantSchedules.java:43) ... 15 common frames omitted 2024-12-31 18:19:48.501 INFO 34018 --- [ocp-schedules-22,764573bd695df384,a5948ba0cca903fa] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2024-12-31 18:19:48.501 INFO 34018 --- [ocp-schedules-25,2ed5ca00e0ffd3d1,3c0014c5b404cdbe] c.o.o.m.service.SeriesIdCleanService : Clean series by rules started. 2024-12-31 18:19:48.504 INFO 34018 --- [ocp-schedules-14,e6e981d631dc20d0,96085e4e2f93cbb5] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:19:48.504 INFO 34018 --- [ocp-schedules-27,817ce7959c0d4576,b7b2f42815b3504b] c.o.o.m.service.SeriesIdCleanService : Clean series by list started. 2024-12-31 18:19:48.504 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : Active profiles: [composite] 2024-12-31 18:19:48.510 INFO 34018 --- [ocp-schedules-23,1ad7a14eb75175a7,16819b6ebcb4048f] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2024-12-31 18:19:48.514 INFO 34018 --- [ocp-schedules-23,1ad7a14eb75175a7,16819b6ebcb4048f] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{} 2024-12-31 18:19:48.515 INFO 34018 --- [ocp-schedules-2,56490aa2ce290300,7b051c6e05b9f49d] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:19:48.510+08:00, clusters=[] 2024-12-31 18:19:48.515 WARN 34018 --- [ocp-async-3,ccc674095d6af73e,f951f77f6ba1d497] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:19:48.515 INFO 34018 --- [ocp-schedules-12,1e3da9bbec474748,3ca66a7cd00a37d8] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:19:48.509+08:00, clusters=[] 2024-12-31 18:19:48.516 INFO 34018 --- [ocp-schedules-9,1ef87f811e65edea,4568c138cdaf5074] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:19:48.516 INFO 34018 --- [ocp-schedules-21,cff214a4e1c631d6,842edf2878ced567] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:19:48.518 INFO 34018 --- [ocp-schedules-22,764573bd695df384,a5948ba0cca903fa] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2024-12-31 18:19:48.521 INFO 34018 --- [ocp-schedules-27,817ce7959c0d4576,b7b2f42815b3504b] c.o.o.m.service.SeriesIdCleanService : Clean series by list finished. 2024-12-31 18:19:48.521 INFO 34018 --- [ocp-schedules-27,817ce7959c0d4576,b7b2f42815b3504b] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache started, seriesIdKeySize=0 2024-12-31 18:19:48.521 INFO 34018 --- [ocp-schedules-27,817ce7959c0d4576,b7b2f42815b3504b] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache ended, seriesIdKeySize=0 2024-12-31 18:19:48.522 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : agent.log.query.http.timeout=60s 2024-12-31 18:19:48.522 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : backup.dbname.prefix=backup 2024-12-31 18:19:48.524 INFO 34018 --- [ocp-schedules-24,31eaa2cd1ea9fb03,de7038c3a680e5d7] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:19:48.524 INFO 34018 --- [ocp-schedules-24,31eaa2cd1ea9fb03,de7038c3a680e5d7] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:19:48.524 INFO 34018 --- [ocp-schedules-10,265646534be3ceae,3026af2711d95fbc] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:19:48.524 INFO 34018 --- [ocp-schedules-10,265646534be3ceae,3026af2711d95fbc] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:19:48.525 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : display-parse-failed-sql=true 2024-12-31 18:19:48.525 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : enable-sql.parse-service=true 2024-12-31 18:19:48.525 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.file=/home/admin/ocp-server/log/ocp.log 2024-12-31 18:19:48.525 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.file.clean-history-on-start=true 2024-12-31 18:19:48.525 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.file.max-history=100 2024-12-31 18:19:48.525 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.file.max-size=100MB 2024-12-31 18:19:48.525 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.file.name=/data2/ocp-home/logs/ocp-server.log 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.file.total-size-cap=10GB 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.level.com.oceanbase.ocp=INFO 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.level.org.hibernate.SQL=INFO 2024-12-31 18:19:48.526 INFO 34018 --- [ocp-schedules-13,ea9ab3f5baea95e9,38b88669aa491e3a] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.level.web=INFO 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.pattern.console=%clr(%d{yyyy-MM-dd HH:mm:ss.SSS}){faint} %clr(%5p) %clr(34018){magenta} %clr(---){faint} %clr([%t,%X{traceId},%X{spanId}]){faint} %clr(%-40.40logger{39}){cyan} %clr(:){faint} %.-2048m%n%wEx 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : logging.pattern.file=%d{yyyy-MM-dd HH:mm:ss.SSS} %5p 34018 --- [%t,%X{traceId},%X{spanId}] %-40.40logger{39} : %.-2048m%n%wEx 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : mgragent.log.level=info 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : monagent.log.level=info 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ob.hidden.parameter.whitelist=__min_full_resource_pool_memory,_rowsets_max_rows,_ob_max_thread_num,_enable_defensive_check,_bloom_filter_ratio,_io_read_batch_size,_io_read_redundant_limit_percentage,_enable_kv_feature 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ob.logcleaner.enabled=true 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ob.logcleaner.run.internal=5m 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.connector.cleanup.period.seconds=300 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.connector.holder.capacity=2000 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.connector.init.executor.thread-count=16 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.connector.init.timeout.millis=10000 2024-12-31 18:19:48.526 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.connector.max-idle.seconds=3600 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.ob.connection.mode=direct 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.obproxy.jdbc.connect.timeout.ms=10000 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.obproxy.jdbc.socket.timeout.ms=10000 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.obproxy.vpc.jdbc.connect.timeout.ms=20000 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.obproxy.vpc.jdbc.socket.timeout.ms=20000 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.operation.global.timeout.millis=300000 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.print.sql=true 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.query.global.timeout.millis=10000 2024-12-31 18:19:48.527 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.slow.query.threshold.millis=1000 2024-12-31 18:19:48.527 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.socket.connect.timeout.millis=2000 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : obsdk.socket.read.timeout.millis=1800000 2024-12-31 18:19:48.527 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp-perf.anomaly.event.analyzer-sql-cpu-percent-limit=15 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp-perf.sql.cure.config={"enabled":true, "analyzeRangeMin" : 5, "offsetMin": 1, "cpuPercentLimit" : 90} 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp-perf.sql.cure.enabled=true 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.auth.metric-auth-enabled=true 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.auth.username=ocp_agent 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.collect.snapshot.status=active 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.home.path.prefix=/home/admin 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.manager.http.port=62888 2024-12-31 18:19:48.527 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.monitor.http.port=62889 2024-12-31 18:19:48.527 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.ob-cleaner.config={"ob_log":{"disk_threshold":80,"rules":[{"file_regex":"[a-z]+.[a-z]+.log.[0-9]+","retention_days":8,"keep_percentage":60},{"file_regex":"([a-z]+.)?[a-z]+.log.wf.[0-9]+","retention_days":30,"keep_percentage":80}]},"core_log":{"disk_threshold":80,"rules":[{"file_regex":"core.[0-9]+","retention_days":8,"keep_percentage":60}]}} 2024-12-31 18:19:48.528 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.snapshot.maxsize=1GB 2024-12-31 18:19:48.528 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.agent.version.full=4.3.2-20241012145836 2024-12-31 18:19:48.528 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.auto.resolved.alarm-types=ob_tenant_task_timeout,ob_host_task_timeout,standby_tenant_sync_delay_too_long 2024-12-31 18:19:48.528 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.channel.modify.enabled=true 2024-12-31 18:19:48.528 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.query-slow-sql-expired-seconds=600 2024-12-31 18:19:48.528 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.query-slow-sql-timeout-seconds=3 2024-12-31 18:19:48.528 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.slow-sql-circuit-breaker-seconds=300 2024-12-31 18:19:48.528 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.slow-sql-exclude-obclusters=sys#* 2024-12-31 18:19:48.528 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.slowsql-query-limit=2000 2024-12-31 18:19:48.528 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.trans-min-duration-seconds=60 2024-12-31 18:19:48.528 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.trans-min-log-size-mb=0.5 2024-12-31 18:19:48.529 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.trans-query-limit=2000 2024-12-31 18:19:48.529 INFO 34018 --- [ocp-schedules-25,2ed5ca00e0ffd3d1,3c0014c5b404cdbe] c.o.o.m.service.SeriesIdCleanService : HostIpSize=0, clusterSize=0, obproxyClusterSize=0 2024-12-31 18:19:48.529 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.trans-stat-circuit-breaker-seconds=300 2024-12-31 18:19:48.529 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.trans-stat-exclude-obclusters= 2024-12-31 18:19:48.529 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.datasource.trans.query-end-time-offset-seconds=15 2024-12-31 18:19:48.529 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.detect.too-many-targets-alarm-threshold=20 2024-12-31 18:19:48.529 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.enabled=true 2024-12-31 18:19:48.529 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.event-readable-cluster-auth=true 2024-12-31 18:19:48.529 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.event.resend-interval-seconds=180 2024-12-31 18:19:48.529 INFO 34018 --- [ocp-async-7,e8dcfe89afed2b24,246ed2b7d1528cb7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:19:48.529 INFO 34018 --- [ocp-schedules-5,3e477cb0b2f716a5,80b53adf63b4f777] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:19:48.529 INFO 34018 --- [ocp-async-6,251d296446e18bf3,2cb5062b3fa7e33b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.host.property=svr_ip 2024-12-31 18:19:48.530 INFO 34018 --- [ocp-schedules-3,bd7a4eb20e6695fb,f1d260757b63b5df] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.notification.archive-batch-count=3000 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.notification.archive-once-times=100 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.notification.expired-days=90 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.query.metric-offset-seconds=10 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.query.metric.only-cache=true 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.query.minute.metric-window-ratio=3 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.query.second.metric-window-ratio=6 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.query.sql.metric-limit=2000 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.resolve-timeout-minutes=60 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.batch-max=20 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.enabled=true 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.once-retry-times=1 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.once-timeout-ms=10000 2024-12-31 18:19:48.530 INFO 34018 --- [ocp-schedules-6,93795a0e44b87f52,be5ce225f68fc89a] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:19:48.530 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.period.ms=2000 2024-12-31 18:19:48.530 INFO 34018 --- [ocp-schedules-6,93795a0e44b87f52,be5ce225f68fc89a] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 0 2024-12-31 18:19:48.531 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.retry-timeout-minutes=60 2024-12-31 18:19:48.531 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.total-failed-retry-times=3 2024-12-31 18:19:48.531 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.total-timeout-seconds=60 2024-12-31 18:19:48.531 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.alarm.send.will-be-sent-in-period-seconds=1800 2024-12-31 18:19:48.531 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.enabled=false 2024-12-31 18:19:48.531 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.es.client.addresses=null 2024-12-31 18:19:48.531 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.es.client.password=null 2024-12-31 18:19:48.531 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.es.client.username=null 2024-12-31 18:19:48.531 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.es.index.keep.days=7 2024-12-31 18:19:48.531 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.es.index.replicas=1 2024-12-31 18:19:48.531 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.es.index.shards=12 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.ob.log.enabled=false 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.analyze.ob.trace.enabled=false 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.application.uuid=e261483c3c9d413780ef23b2dcfa4157 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.audit.enabled=true 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.advanced-secondary-backup.enabled=false 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.advanced-secondary-backup.target-cloud-location= 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.advanced-secondary-backup.target-cloud-name= 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.agent.relation.file.full-path.name=#{systemProperties['user.home'].concat('/ocp-server/etc/backup_agent_ob_relations_config.yaml')} 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.alarm.backup-liboblog-expire-days=7 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.backup-command.timeout=300 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.logical.log.meta.time.continuity.threshold.seconds=10 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.obs.support.enabled=false 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.oss.support.cname=true 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.restore-time-pre-check.enabled=true 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.command.timeout=3600000 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.host.task.concurrency=8 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.max.retry.times=2 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.obtain-idle-host-interval-seconds=60 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.obtain-idle-host-times=60 2024-12-31 18:19:48.532 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.period.minutes=180 2024-12-31 18:19:48.533 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.schedule.enabled=true 2024-12-31 18:19:48.533 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.backup.storage.collect.task.timeout=10800000 2024-12-31 18:19:48.533 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.build.version.check=false 2024-12-31 18:19:48.533 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ce.supported.ob.regex=^oceanbase-actiondb-(\d+\.){2}(\d+)(\.\d+)?-([\d.]+)\.([a-zA-Z0-9]+)\.(x86_64|aarch64)(\.rpm)?$ 2024-12-31 18:19:48.533 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.check.host.http.read.timeout=5000 2024-12-31 18:19:48.533 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.cloud.data.platform.site.url=null 2024-12-31 18:19:48.533 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.cloud.meta.platform.site.url=null 2024-12-31 18:19:48.533 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.cluster.obVersion.parameter.template.relation=[{"versionList":["2.2.77"],"parameterTemplateName":"ob.cluster.parameter.template.built-in.default-2-2-77.name"}] 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config-url.site.url= 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config-url.use-request-address=true 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.cache.refresh.interval=60 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.datasource.connect-timeout=2000 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.datasource.socket-timeout=30000 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.initialSize=10 2024-12-31 18:19:48.534 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:19:48.534 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:19:48.534 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.keepAlive=true 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.maxActive=100 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.maxWait=2000 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.minIdle=2 2024-12-31 18:19:48.534 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.name=config-server-connect-pool 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.testWhileIdle=true 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.config.server.druid.validationQuery=SELECT 1 FROM DUAL 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.distributed.server.expire.seconds=30 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.distributed.server.update.seconds=10 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.distributed.service.expire.seconds={CMDB_SYNCER:30, TASK_MANAGER:30, RATE_LIMIT:30, PERF_SQL_ROLLUP:30, SQL_INDEX_DIAGNOSER:30, SQL_PERF_DIAGNOSER:30, PLAN_CHANGE_DETECTOR:30, MC_MANAGER:30} 2024-12-31 18:19:48.534 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.distributed.service.update.seconds={CMDB_SYNCER:10, TASK_MANAGER:10, RATE_LIMIT:10, PERF_SQL_ROLLUP:15, SQL_INDEX_DIAGNOSER:30, SQL_PERF_DIAGNOSER:30, PLAN_CHANGE_DETECTOR:30, MC_MANAGER:10} 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.event.snapshot.maxage-days=90 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.built-in.bucket=built-in 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.default-block-split-size=1048576 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.has.signature.keywords.list=PGP,signatures 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.local.built-in.dir=/data2/ocp-home/ocp/ocp-server/lib 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.local.dir=/data2/ocp-home 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.max-concurrent-count=16 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.oss-block-split-size=1048576 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.signature.check.enabled=true 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.signature.check.invalid.keywords.list=NOT OK 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.supported-architecture=x86_64,AArch64 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.sys-package.bucket=sys-package 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.file.try-lock-timeout-milliseconds=60000 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.health-check.config.threshold={"-1":{"host_load":{"load1_per_cpu":2},"host_disk_status":{"host_disk_used_percent":85},"host_time":{"clock_diff":500,"ssh_interval":1000},"ob_server_disk_status":{"observer_disk_threshold_percentage":80},"ob_server_partition_count":{"ob_server_partition_count":100000},"obproxy_connection_count":{"obproxy_session_count_percentage":80}}} 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.health-check.status.available-keyword=okay 2024-12-31 18:19:48.535 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.health-check.status.unavailable-keyword=bad 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.check.clock-diff.enable=true 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.check.clock-diff.max-diff=50 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.check.clock-diff.mode=0 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.clockdiff.timeout.millis=20000 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.remote-command.default-timeout-millis=30000 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.remote-command.min-timeout-millis=30000 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.host.ssh-ping.max-delay-millis=3000 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.account.system.active=false 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.auth=composite 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.auth.access-key.enabled=true 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.auth.basic.enabled=true 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.auth.whitelist=/api/v2/time,/api/v2/mc/info,/api/v2/sensitiveDataKey,/api/v2/obproxy/loadBalanceInfo.*,.*Action=(ObRootServiceInfo|ObRootServiceRegister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName|GetObRootServiceInfoUrlTemplate|ObRootServiceUnregister|GetObTenantInfoByServiceNames|RegisterObTenantInfo|ModifyTenantInfo|DeleteTenantInfo).*,performance/ash/reports/.*/data 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.csrf.enabled=true 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.csrf.url.excluded=/api/v2/iam/login.*,.*Action=(ObRootServiceInfo|ObRootServiceRegister|ObRootServiceUnregister|ObIDCRegionInfo|GetObProxyConfig|AllocateClusterIdByNameAndIdx|DeleteObRootServiceInfoByClusterName|RegisterObTenantInfo|ModifyTenantInfo|DeleteTenantInfo).*,/api/v2/monitor/metric/scan.* 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.login.client.lockout-minutes=1 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.login.client.max-attempts=60 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.login.client.white-list=null 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.login.lockout-minutes=30 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.login.max-attempts=5 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.preserved.username.list=admin,sys,system,sysdba,dba,oceanbase,obproxy,proxyro,ocp,ocp_monitor,ocp_agent,odc,oms,backup,drc,lbacsys,odp,temp 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.rate-limit.enabled=true 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.rate-limit.internal-api.connect.timeout=1000 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.rate-limit.internal-api.read.timeout=1000 2024-12-31 18:19:48.536 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.rate-limit.on-ip.enabled=false 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.rate-limit.on-user.enabled=true 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.rate-limit.task.schedule.period=3 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.role.forbidden.update.username.list=admin,system,obproxy,ocp_admin,monitor 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.sso-login-url= 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.iam.user.access-key.max.count=5 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.idempotent.client-token.expire.time=14d 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.inspection.report.expired.cleanup.enabled=false 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.inspection.report.expired.days=15 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.internal.rpc.user.username=system 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.log.download.http.connect.timeout=180000 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.log.download.http.read.timeout=180000 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.log.download.tmp.dir=/data2/ocp-home/ocp/logs/ocp 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.log.max-download-speed=1024 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.log.query.http.read.timeout=70000 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.meta.cluster.name= 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.meta.disconnect.alarm.minutes=2 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.metric.async-compute.enabled=true 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.metric.collect.interval.second=15 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.async-compute.query.minute.enable=false 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.async.query.min.time.buffer.second=0 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.async.write.queue.capacity=5000000 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.enabled=true 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.host.enabled=true 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.max-pool-size=3000 2024-12-31 18:19:48.537 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.obcluster.enabled=true 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.obproxy.enabled=true 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.obsdk.sql-query-row-limit=10000 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.collect.request.timeout={"second_connect_timeout":1000,"second_read_timeout":1000,"second_request_timeout":2000,"minute_connect_timeout":10000,"minute_read_timeout":30000,"minute_request_timeout":40000} 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.custom.collectItem.sql.function.whiteList=count,time_to_usec,timestampdiff,coalesce,sum,max,avg,min,round,unix_timestamp,abs 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.data.retention-days={"ob_cluster_system_event":31,"ob_cluster_server_event":31,"ocp_metric_data_1":8,"ocp_metric_data_60":31,"metric_data_async":1,"metric_hour_data":1098,"metric_daily_data":1098} 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.data.table-switch-time=1735640001 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.datasource.query.timeout.sec=120 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.datasource.socket.timeout.ms=120000 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.deletable.metricNames=process_count|app=HOST|name=observer,process_count|app=HOST|name=obproxy,process_cpu_percent|app=HOST|name=observer,process_cpu_percent|app=HOST|name=obproxy,process_exists|app=HOST|name=observer,process_exists|app=HOST|name=obproxy,process_fd_count|app=HOST|name=observer,process_fd_count|app=HOST|name=obproxy,process_memory_rss_bytes|app=HOST|name=observer,process_memory_rss_bytes|app=HOST|name=obproxy,process_thread_count|app=HOST|name=observer,process_thread_count|app=HOST|name=obproxy,process_uptime_seconds|app=HOST|name=observer,process_uptime_seconds|app=HOST|name=obproxy,ob_system_event_detail_total_waits,ob_system_event_detail_total_timeouts,ob_system_event_detail_time_waited_us,ob_system_event_detail_total_waits,ob_system_event_detail_total_timeouts,ob_system_event_detail_time_waited_us,ob_latch_get_total,ob_latch_miss_total,ob_latch_sleep_total,ob_latch_immediate_get_total,ob_latch_immediate_miss_total,ob_latch_spin_get_total,ob_latch_wait_seconds_total,ob_tenant_context_memory_hold_bytes,ob_tenant_context_memory_used_bytes,ob_tenant_context_memory_count 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.exporter.check-active-period-seconds=30 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.exporter.check-inactive-period-seconds=30 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.exporter.inactive.threshold.seconds=180 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.host.exporters=/metrics/node/host 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.logproxy.exporters=/metrics/logproxy 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.metric.archive.downgrade.enabled=true 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.metric.interval.factor=2 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.metric.service.type=LOCAL 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.minute.exporters=/metrics/ob/extra,/metrics/obcloud/extra 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.minute.write.queue.capacity=5000000 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.ob.exporters=/metrics/node/ob,/metrics/ob/basic,/metrics/ob/extra 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.obproxy.exporters=/metrics/node/obproxy,/metrics/obproxy 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.prometheus.service.discovery.enabled=true 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.second.exporters=/metrics/node/host,/metrics/node/ob,/metrics/ob/basic,/metrics/node/obproxy,/metrics/obproxy,/metrics/node/oblb,/metrics/node/obdns,/metrics/logproxy 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.second.write.queue.capacity=5000000 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitor.server.exporter.auth.enabled=true 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.database=monitor_database 2024-12-31 18:19:48.538 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.driverClassName=com.oceanbase.jdbc.Driver 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.initialSize=10 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.keepAlive=true 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.maxActive=200 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.maxWait=2000 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.minIdle=2 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.name=monitordb-connect-pool 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.testWhileIdle=true 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.druid.validationQuery=SELECT 1 FROM DUAL 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.hikari.ConnectionTimeout=2000 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.hikari.connectionTestQuery=SELECT 1 FROM DUAL 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.hikari.maximumPoolSize=200 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.hikari.minimumIdle=10 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.hikari.poolName=monitor-connect-pool 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.host=10.79.169.37 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.password=****** 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.port=2881 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.public-key=null 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.series.scan.batch-size=2000 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.monitordb.username=root@ocp_monitor 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.multicloud.monitordb.password-secret-key=****** 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.network.inter-connector.agent.socks-port=1080 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.network.inter-connector.host-address=localhost 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.network.inter-connector.socks-port=1080 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.network.inter-connector.web-port=8088 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.network.vpc.mode.enabled=false 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.cluster.ops.blacklist= 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.database.name.pattern=^[a-z][a-z_0-9]{1,127}$ 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.resource.cache.enable=false 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.resource.cache.refresh.thread-core-size=20 2024-12-31 18:19:48.539 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.resource.cache.refresh.thread-max-size=200 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.slowsql.threshold=100000 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.standby.replication.role.privilege.objects=DBA_OB_TENANTS,DBA_OB_LS_HISTORY,GV$OB_UNITS,GV$OB_PARAMETERS,GV$OB_LOG_STAT,DBA_OB_LS,DBA_OB_ACCESS_POINT 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.switchover.check.to.primary.wait-period-seconds=3 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.upgrade.allow-downgrade=false 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.upgrade.clean-tmp-rpm=true 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.upgrade.dependencies.full-path.name=#{systemProperties['user.home'].concat('/ocp-server/etc/oceanbase_upgrade_dep.yml')} 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.ob.upgrade.script.cmd.timeout=0 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.obcloud.api.address= 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.obproxy.query-with-ob-connections=true 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.cgroup.minimum-ob-version=4.0.0.0 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.default.os.user=admin 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.connector.cache.max-idle-seconds=3600 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.connect-timeout=5000 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.connection.max-per-route=100 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.connection.max-pool-size=100 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.read-timeout=30000 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.socket-timeout=3000 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.thread.core-pool-size=500 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.thread.keep-alive-time=120000 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.http.thread.max-pool-size=1500 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.ssh.connect-timeout=10000 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.executor.ssh.default-command-timeout=10000 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.delete-server.reserve-data-enabled=false 2024-12-31 18:19:48.540 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.host.arm-lse-supported=true 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.resource.trend.max-point=1440 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.server.skip-io-bench=false 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.single-idc-for-zone-enabled=true 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.sql-execute.enabled=false 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.sql-execute.sql-type.whitelist=SELECT,SHOW 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.tenant.whitelist.attach-default-whitelist=true 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.ob.unit.unused.max-reserve-hour=1 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.obproxy.prohibit.obsharding.operation=true 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.obproxy.readonly.default.password=****** 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.obproxy.readonly.default.username=proxyro 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.obproxy.skip-set-proxyro-password=****** 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.operation.odp.root.default.password=****** 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.alarm.status.refresh.interval=10000 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.backup.status.refresh.interval=300000 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.cluster.status.refresh.interval=10000 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.host.status.refresh.interval=10000 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.obproxy.status.refresh.interval=10000 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.performance.status.refresh.interval=300000 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.tasks.status.refresh.interval=10000 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.overview.tenant.status.refresh.interval=10000 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.ash.earliest-analyse-time=8 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.ash.max-analyse-range=60m 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.ash.report-retention-days=90 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.big.transaction.log.threshold.byte=524288 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.big.transaction.time.threshold.ms=500 2024-12-31 18:19:48.541 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.collect.metadb.enabled=false 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.count-sql.slow-sql-explicitly=true 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.oas.stat.enabled=true 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.ocp.monitor.password=****** 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.ocp.monitor.public.key=****** 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.parallel.sql.limit=2000 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.parallel.sql.partition.retention.days=15 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.snapshot.generation.enable=0 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.snapshot.generation.enable.in.147x-meta-cluster=false 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.snapshot.generation.white-list=null 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.awful-performance-index-used-config={"enabled":true, "cpuTimeLimitUs":100000, "execPsLimit":5.0, "fullLogicalReadsLimit":1000} 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.cpu-time-proportion-high-config={"enabled":true, "cpuTimeLimitUs":10000, "execPsLimit":10.0, "maxCpuTimeLimitUs":30000, "affectedRowsLimit":100, "execLimit":30, "sqlCountLimit":20, "cpuTimePercentLimit":20} 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.database-white-list=oceanbase,information_schema,mysql,__recyclebin,sys,__public 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.diagnose.standby-cluster.enabled=False 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.execution-spike-config={"enabled":true, "cpuTimeLimitUs":3000, "execPsLimit":5.0, "pointsLimit":5, "compareMin":20, "avgExecutionMultiply":{"0":6, "1":5, "5":4, "10":3, "50": 2.5, "100": 2, "500": 1.6}, "stdExecutionMultiply":{"0":80, "1":60 , "3": 30,"5":20, "10":15, "20":8, "30":6, "50":5, "80":4}} 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.index-diagnoser-config={"enabled":true,"schedulePeriodMin":5, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":10000,"diagPeriodSec":300,"diagOffsetSec":60,"maxDiagPeriodSec":1800} 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.ineffective-hint-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.outline-history-query-days=30 2024-12-31 18:19:48.542 INFO 34018 --- [ocp-schedules-24,31eaa2cd1ea9fb03,de7038c3a680e5d7] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.perf-diagnoser-config={"enabled":true,"schedulePeriodMin":5, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":10000,"diagPeriodSec":300,"diagOffsetSec":60,"maxDiagPeriodSec":1800} 2024-12-31 18:19:48.542 INFO 34018 --- [ocp-schedules-24,31eaa2cd1ea9fb03,de7038c3a680e5d7] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.performance-degradation-after-plan-changed-config={"enabled":true, "compareMin":5, "cpuTimeMultiply":{"0":50, "1":20, "10":10, "100":3, "1000":2},"alarm":true} 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.performance-degradation-config={"enabled":true, "cpuTimeLimitUs":10000, "execPsLimit":5.0, "maxCpuTimeLimitUs":30000, "affectedRowsLimit":100, "execLimit":5, "compareMin":20, "cpuTimeMultiply":{"0":50, "1":20, "10":10, "100":3, "1000":2}, "alarm":true, "sysTenantEnabled":false} 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.query-timeout=30000000 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.row-lock-contention-high-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":100000, "elapsedTimeLimitUs":0} 2024-12-31 18:19:48.542 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.sql-diagnosis-retention-days=30 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.table-scan-index-not-exists-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.table-scan-index-not-used-config={"enabled":true, "execPsLimit":5.0, "cpuTimeLimitUs":20000} 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql-diag.tenant-white-list=null 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.advisor-plan-max-query-range=7d 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag-plan-change-config={"enabled":true,"schedulePeriodMin":2, "coreThreadSize":8, "maxThreadSize":16,"maxQueueSize":500,"diagPeriodSec":120,"diagOffsetSec":120,"maxDiagPeriodSec":600} 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.affected-rows-threshold=50000 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.core-pool-size=30 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.max-period-timeUs=1800000000 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.max-pool-size=300 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.max-queue-size=1000000 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.max-thread-pool-task-limit=50000 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.partition-count-threshold=2000 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.high-risk-task.return-rows-threshold=50000 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-queue-max-size=1000000 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-worker-core-size=30 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.diag.sql-audit-stat-worker-max-size=300 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.earliest-query-time=8d 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.high-risk-inspect-service.enable=True 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.high-risk-max-query-range=7d 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.index-advisor-cpu-time-threshold=10 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.index-advisor-elapsed-time-threshold=20 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.info.parameterize.sql=false 2024-12-31 18:19:48.543 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.info.parse.sql.type=true 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.max-query-range=24h 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.new-sql.limit=2000 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.new-sql.query.compare.interval.days=7 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.new-sql.query.interval.days=7d 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.oas.schema-advice.rows.limit=1000000 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.oas.schema-advice.table.limit=32 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.oas.schema-advice.table4.limit=20 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.parse.batch.insert.size=100 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.parse.core.thread=8 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.parse.insert.query.rate.limit=10 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.parse.max.thread=16 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.parse.query.limit=2000 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.parse.queue.size=20000 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-granularity=30s 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-query-interval=2h 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.plan-hist-level0-retention=5d 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.prepare-partition-ahead=8 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.query-digest-limit=0 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.query-digest-trend.points=15 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.query-timeout=30000000 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.query.high-risk-sql.sql-text-short-length=50 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.slow-sql-limit=2000 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-audit-sample-retention=7d 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-granularity=30s 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-query-interval=2h 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level0-retention=2d 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-granularity=2m 2024-12-31 18:19:48.544 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-query-interval=12h 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level1-retention=8d 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-granularity=10m 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-query-interval=48h 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-hist-level2-retention=15d 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-info-secondary-cache-expiration=10m 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-query-digest-level0-query-interval=30m 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-query-digest-level1-query-interval=2h 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-stat-rollup-worker-disabled=false 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.sql-stat-rollup-worker-disabled.in.147x-meta-cluster=true 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.top-sql-limit=2000 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.top-sql.query-parallel=0 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.tuning-advisor-cpu-time-multiply-of-plan-comparison={"0":10, "1":5, "10":2, "100":1.5, "1000":1.2} 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.sql.tuning-advisor-cpu-time-ratio-of-plan-comparison=0.8 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.detail.query.range.minute=30 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.interval.second=5 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.long.transaction.threshold.second=60 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.partition.retention.days=7 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.pending.transaction.threshold.second=60 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.query.sql.sample.timeout.second=30 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.transaction.sql.count.limit=10000 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.workload.generate-report-thread-count=5 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.perf.workload.report.tenant-top-sql-limit=10 2024-12-31 18:19:48.545 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.request.client.ip.from-header=false 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.request.client.ip.header-candidates=X-Forwarded-For 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.sensitive-data.encryption.private-key=****** 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.sensitive-data.encryption.public-key=****** 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.server.event.included={sql: {}, daily_merge:{}, election:{}, physical_restore:{}, observice:{}, observer:{}, clog_restore:{}, warmup:{}, log_archive:{}, archive_log:{}, minor_merge:{}, ddl:{"create_partition", "batch_create_partition", "add_replica", "remove_member", "batch_remove_member", "batch_modify_quorum", "batch_change_replica", "migrate_replica", "remove_replica", "rebuild_replica"}, freeze:{"do minor freeze fail"}, storage:{"add_replica failed", "migrate_replica failed", "reubild_replica failed", "change_replica failed", "log is new enough, turn off rebuild flag", "remove_replica failed", "restore follower replica failed", "restore_replica failed", "batch change_replica failed", "copy global index failed", "restore_standby_replica failed", "rebuild_replica failed"}} 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.server.readonly.mode.enabled=false 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.site.url=http://10.79.169.37:8080 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.standby.tenant.delay.threshold=5000 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.startup-check.metadb.variable=[{"variableName": "max_allowed_packet", "operator": ">=", "targetValue": 4194304}, {"variableName": "ob_read_consistency", "operator": "=", "targetValue": "STRONG"}] 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.startup-check.monitordb.variable=[{"variableName": "max_allowed_packet", "operator": ">=", "targetValue": 4194304}, {"variableName": "ob_read_consistency", "operator": "=", "targetValue": "STRONG"}] 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.subtask.minimum-timeout-secs=-1 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.subtask.prohibit.skip.names=[] 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.default.language=zh-CN 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.default.timezone= 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.event.excluded={balancer: {"start_sql_bkgd_task","finish_sql_bkgd_task"}, schema_recycler: {}} 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.obproxy.metadb.cluster-name=obdv1 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.obproxy.metadb.database=obproxy 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.obproxy.metadb.enabled=false 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.obproxy.metadb.sensitive-info={"configuredInfo":{"antmeta":{"root@sys":"9f6e186723de2f4873cad637e0e8b6e9"},"obdv1":{"root@obproxy":"8f3bab5c8face32f3a7da34de0773c9b"}},"defaultInfo":{"default":"899f7ad059fc3a3c19dee85886a8f45a7e67dd4896dbeb93"}} 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.system.obproxy.metadb.user=root@obproxy 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.table-cleaning.batch-interval-millis=10 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.table-cleaning.batch-size=1000 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.table-cleaning.preserve-days=30 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.table-cleaning.thread.core-pool-size=4 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.table-cleaning.thread.maximum-pool-size=16 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.tag.usage.max.count=5000 2024-12-31 18:19:48.546 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.prohibit.skip.names=["Upgrade OB cluster"] 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.alarmDetectOnce.fixedDelay=10 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.alarmDetectOnce.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.fixAlarmTarget.fixedDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.fixAlarmTarget.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshActiveAlarmStatus.fixedDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshActiveAlarmStatus.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAggregators.fixedDelay=10 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAggregators.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmInMemory.fixedDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmInMemory.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmSummary.fixedDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmSummary.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmTargets.fixedDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmTargets.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmTaskManager.fixedDelay=20 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshAlarmTaskManager.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshBackupAlarmStat.fixedDelay=180 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshBackupAlarmStat.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshDetectorFactory.fixedDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshDetectorFactory.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshGlobalSilencer.fixedDelay=10 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshGlobalSilencer.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshHostAlarmInfo.fixedDelay=600 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.refreshHostAlarmInfo.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.removeInactiveAlarmEvents.fixedDelay=600 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.removeInactiveAlarmEvents.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.resolveAlarmsOfAbsentTargets.fixedDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.alarm.resolveAlarmsOfAbsentTargets.initialDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.binlog.syncBinlogClusters.fixedDelay=30 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.binlog.syncBinlogInstances.fixedDelay=60 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkCpuBindCore.fixedRate=30 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkCpuBindCore.initialDelay=120 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostAgentStatus.fixedRate=30 2024-12-31 18:19:48.547 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostAgentStatus.initialDelay=120 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostClockDiff.fixedRate=30 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostClockDiff.initialDelay=120 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostStatus.fixedRate=30 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostStatus.initialDelay=120 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostVersion.fixedDelay=4 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostVersion.initialDelay=30 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.checkHostVersion.timeUnit=MINUTES 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.getHostAgentAlarms.fixedDelay=1 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.getHostAgentAlarms.initialDelay=2 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.getHostAgentAlarms.timeUnit=MINUTES 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.refreshAgentConfig.fixedDelay=10 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.refreshAgentConfig.initialDelay=2 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.host.refreshAgentConfig.timeUnit=MINUTES 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.checkOdpClient.fixedDelay=60 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.checkVpcConnect.fixedDelay=5 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.cleanTaskLog.cron=0 10 3 * * * 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.cleanTaskRecords.cron=0 20 5 * * * 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.cleanTmpLogFiles.cron=0 20 4 * * * 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.cleanupDruidCache.fixedDelay=300 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.cleanupDruidCache.initialDelay=600 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.collectOdpMetrics.fixedDelay=60 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.ocpReplicationDaemon.fixedDelay=5 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.partitionDaemon.fixedDelay=600 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.partitionDaemon.initialDelay=120 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.local.refreshOcpConfig.fixedDelay=180 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.checkAllArbitrationService.fixedRate=30 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.checkClusterRootServer.fixedRate=300 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.checkClusterStatus.fixedRate=30 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.checkStandbyClusterInfo.fixedRate=30 2024-12-31 18:19:48.548 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.collectAllClusterCompaction.fixedDelay=60 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.syncClusterInfo.fixedRate=30 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.syncClusterSystemEvent.fixedDelay=600 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obCluster.syncRootServer.fixedDelay=120 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obTenant.checkAllStandbyTenant.fixedRate=30 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obTenant.checkAllTenantServiceNameConflict.fixedDelay=60 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obTenant.collectAllTenantMajorCompaction.fixedDelay=60 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obTenant.collectAllTenantMiniCompaction.fixedDelay=300 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obTenant.syncAllTenantInfo.fixedDelay=60 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obproxy.checkObproxyServers.cron=10/30 * * * * * 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obproxy.checkObproxyServers.initialDelay=120 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obproxy.collectObproxyMetrics.cron=10/30 * * * * * 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.obproxy.collectObproxyMetrics.initialDelay=120 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.perf.collectHighSqlAuditStat.fixedDelay=300 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.perf.collectHighSqlAuditStat.initialDelay=120 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.perf.collectSlowSqlForAlarm.fixedDelay=60 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.perf.collectTransStatForAlarm.fixedDelay=60 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.perf.oasSqlCuring.fixedDelay=60 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.task.scheduled.pool.coreSize=30 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.tenant.username.pattern.mysql=^[a-z][a-z_0-9]{1,127}$ 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.version=4.3.2 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.version.full=4.3.2-20241012145836 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.web.context-path=/ 2024-12-31 18:19:48.549 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ocp.web.tracking.enabled=1 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : odp.client.automatic-match-work-thread=false 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : odp.client.enable-strict-kernel-release=false 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : odp.client.log-dir-size-threshold=1G 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : odp.client.proxy-mem-limited=1G 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : odp.client.syslog-level=INFO 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : odp.client.work-thread-num=8 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : perf.sql.top-sql-comparison.elapsed-time-increase-limit=0.2 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : perf.sql.top-sql-comparison.error-percentage-increase-limit=0.1 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : perf.sql.top-sql-comparison.executions-increase-limit=0.2 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : perf.sql.top-sql-comparison.new-in-top-n-limit=100 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : perf.sql.top-sql-comparison.remote-plan-percentage-increase-limit=0.1 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : perf.sql.top-sql-comparison.return-rows-increase-limit=0.2 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.address=0.0.0.0 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.port=8090 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.servlet.session.cookie.name=SESSION 2024-12-31 18:19:48.550 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.servlet.session.cookie.same-site=null 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.servlet.session.cookie.secure=null 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.servlet.session.timeout=30m 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.ssl.enabled=false 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.ssl.key-alias=null 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.ssl.key-password=null 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.ssl.key-store= 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.ssl.key-store-password=****** 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : server.ssl.key-store-type=PKCS12 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : slow-sql.query-sql-info-from.cache.directly=false 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.data.web.pageable.max-page-size=5000 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.data.web.pageable.one-indexed-parameters=true 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.initialSize=10 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.keepAlive=true 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.maxActive=200 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.maxWait=2000 2024-12-31 18:19:48.551 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.minIdle=2 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.name=metadb-connect-pool 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.testWhileIdle=true 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.druid.validationQuery=SELECT 1 FROM DUAL 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.hikari.ConnectionTimeout=2000 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.hikari.connectionTestQuery=SELECT 1 FROM DUAL 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.hikari.maximumPoolSize=200 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.hikari.minimumIdle=10 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.datasource.hikari.poolName=metadb-connect-pool 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.jpa.hibernate.naming-strategy=org.hibernate.cfg.ImprovedNamingStrategy 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.jpa.properties.hibernate.dialect=org.hibernate.dialect.MySQL5Dialect 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.jpa.properties.hibernate.globally_quoted_identifiers=true 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.servlet.multipart.enabled=true 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.servlet.multipart.max-file-size=2048MB 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : spring.servlet.multipart.max-request-size=2048MB 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : springdoc.api-docs.enabled=false 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : springdoc.api-docs.path=/doc/api-docs 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : springdoc.paths-to-exclude=null 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : springdoc.paths-to-match=/api/v2/** 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : springdoc.swagger-ui.path=/doc/swagger-ui.html 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : sql-stat.flush-sql-info-to-cache=true 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : storage.capacity.compute.executor.core-pool-size=8 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : storage.capacity.compute.executor.max-pool-size=64 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : storage.capacity.compute.executor.task-queue-size=1800 2024-12-31 18:19:48.552 INFO 34018 --- [main,,] c.o.o.s.common.trace.PropertyLogger : ****************************************************************************** 2024-12-31 18:19:48.559 INFO 34018 --- [ocp-schedules-5,3e477cb0b2f716a5,80b53adf63b4f777] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:19:48.560 INFO 34018 --- [main,,] c.oceanbase.ocp.OcpCeServerApplication : Started OcpCeServerApplication in 143.204 seconds (JVM running for 144.408) 2024-12-31 18:19:48.566 INFO 34018 --- [ocp-schedules-25,2ed5ca00e0ffd3d1,3c0014c5b404cdbe] c.o.o.m.service.SeriesIdCleanService : Clean series by rules finished. 2024-12-31 18:19:48.566 INFO 34018 --- [ocp-schedules-25,2ed5ca00e0ffd3d1,3c0014c5b404cdbe] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache started, seriesIdKeySize=0 2024-12-31 18:19:48.566 INFO 34018 --- [ocp-schedules-25,2ed5ca00e0ffd3d1,3c0014c5b404cdbe] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache ended, seriesIdKeySize=0 2024-12-31 18:19:48.583 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:19:48.591 INFO 34018 --- [main,,] c.o.o.s.c.analyzer.OcpPostStartupRunner : Setup sensitive data utils, publicKey=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQC4RG0d4r/p1eGjCZdy5fsVy1p2XSAATOFPv/XgcWlRRTb7Z+M+WxoSjwqNllEJuKXpoVnWdcDnjtR61lwMy+yS5mrxHN+vUh2ssZNuVXEQ3VXBn2AB6DbJp5xMcHYRbyAe5P866kCUaSRaoG1WTGbXRVOizbKwmkA1EYXDgj9sGwIDAQAB 2024-12-31 18:19:48.594 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:19:48.594 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:19:48.595 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:19:48.595 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:19:48.595 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Metadb, table=profile_credential_sharing 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Metadb, table=ocp_cache_info 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_0 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_1 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat_2 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_stat 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sqltext 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_dynamic_sql 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_high_risk_sql 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_plan_cache_plan_explain 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_sample 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_perf_sql_diagnosis_task 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_perf_sql_diagnosis 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_active_session_stat_0 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_snapshot 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_cluster 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_tenant 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_server 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_replica 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sysstat 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_row_lock 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_latch 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_cache 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_parameter 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_rpc 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_packet 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_clog 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_location_cache 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_gts 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_system_event 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_memory 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_partition_hit 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_sql_plan_monitor 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_trans_stat_v2 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_cluster_system_event 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_cluster_server_event 2024-12-31 18:19:48.596 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_metric_data_1 2024-12-31 18:19:48.597 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ocp_metric_data_60 2024-12-31 18:19:48.597 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_hour_data 2024-12-31 18:19:48.597 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_daily_data 2024-12-31 18:19:48.597 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_second 2024-12-31 18:19:48.597 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_minute 2024-12-31 18:19:48.597 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_hour 2024-12-31 18:19:48.597 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_daily 2024-12-31 18:19:48.597 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=metric_data_async 2024-12-31 18:19:48.597 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=sql_aggregate_data 2024-12-31 18:19:48.597 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_hist_partition_stats_compressed 2024-12-31 18:19:48.597 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167001] Loading policy, scope=Monitordb, table=ob_tenant_mini_compaction_info 2024-12-31 18:19:48.599 ERROR 34018 --- [ocp-async-9,d31a887b29659d60,75caca5b29aa8916] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.NotFoundException occurred with code error.common.not.found, and args [task not exist., 999989] 2024-12-31 18:19:48.599 INFO 34018 --- [ocp-async-9,d31a887b29659d60,75caca5b29aa8916] c.o.o.c.t.e.m.TaskDefinitionManagerImpl : Task not found, task id :999989 2024-12-31 18:19:48.599 INFO 34018 --- [ocp-async-9,d31a887b29659d60,75caca5b29aa8916] c.o.o.s.c.l.ApplicationStartedListener : Begin to init proxyro password config in sys tenant 2024-12-31 18:19:48.600 INFO 34018 --- [main,,] c.o.o.s.p.PartitionRolloverService : [OCP167004] Submitting initial worker 2024-12-31 18:19:48.601 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:19:48.602 INFO 34018 --- [ocp-async-9,d31a887b29659d60,75caca5b29aa8916] c.o.o.s.c.l.ApplicationStartedListener : Success to init proxyro password config in sys tenant 2024-12-31 18:19:48.602 INFO 34018 --- [main,,] c.o.o.s.c.analyzer.OcpPostStartupRunner : OCP application uuid is e261483c3c9d413780ef23b2dcfa4157. 2024-12-31 18:19:48.602 INFO 34018 --- [main,,] c.o.o.s.c.analyzer.OcpPostStartupRunner : OCP boot ok! 2024-12-31 18:19:48.605 INFO 34018 --- [main,,] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT2M23.250598998S 2024-12-31 18:19:48.605 INFO 34018 --- [main,,] c.o.o.b.spring.BootstrapRunListener : ocp is ready! 2024-12-31 18:19:48.609 INFO 34018 --- [ocp-async-3,722c32d98ec6589a,75ffee93b8f355c1] c.o.o.p.a.i.SessionEventSyncService : start to sync session wait event info, cluster ids is [] 2024-12-31 18:19:48.609 INFO 34018 --- [ocp-async-3,722c32d98ec6589a,75ffee93b8f355c1] c.o.o.p.a.i.SessionEventSyncService : Sync session wait event info finished, cluster ids is [] 2024-12-31 18:19:48.610 INFO 34018 --- [main,,] c.o.o.b.ext.ReinstallAgentAfterUpgrade : ReinstallAgentAfterUpgrade created 2024-12-31 18:19:48.610 INFO 34018 --- [main,,] c.o.o.b.ext.SetProxyIdAfterUpgrade : SetProxyIdAfterUpgrade created. 2024-12-31 18:19:48.623 WARN 34018 --- [main,,] c.o.o.o.i.ObproxyOperationServiceImpl : No obproxy needs to set proxy_id, input param is empty. 2024-12-31 18:19:48.624 INFO 34018 --- [main,,] c.o.o.b.ext.SetProxyIdAfterUpgrade : Submit task null success, assign proxy_id for obproxies []. 2024-12-31 18:19:48.624 INFO 34018 --- [main,,] c.o.o.b.ext.ReinstallAgentAfterUpgrade : not UPGRADE, skip reinstall agent 2024-12-31 18:19:48.800 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:19:48.803 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:19:48.922 INFO 34018 --- [ocp-async-10,93cfe403787200b1,c474456c9d7f1680] c.o.o.c.t.e.coordinator.TaskCoordinator : Start task coordinator 2024-12-31 18:19:48.954 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2024-12-31 18:19:49.094 INFO 34018 --- [ocp-async-10,93cfe403787200b1,c474456c9d7f1680] c.o.o.s.common.config.TaskEngineRunner : Startup subtask coordinator. subtask=592 2024-12-31 18:19:49.094 INFO 34018 --- [ocp-async-10,93cfe403787200b1,c474456c9d7f1680] c.o.o.c.t.e.c.SubtaskCoordinator : Start subtask coordinator 2024-12-31 18:19:49.423 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT0.888957614S 2024-12-31 18:19:49.423 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:19:49.501 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2024-12-31 18:19:49.501 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2024-12-31 18:19:49.533 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 2024-12-31 18:19:49.612 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:19:49.612 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:19:49.612 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:19:49.612 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:19:49.612 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:19:49.612 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2024-12-31 18:19:49.620 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:19:49.740 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] o.s.boot.SpringApplication : Started application in 1.213 seconds (JVM running for 145.588) 2024-12-31 18:19:49.740 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT1.213436341S 2024-12-31 18:19:50.198 INFO 34018 --- [ocp-schedules-29,c9d8d24a03396bb3,fd4fd626c2c12177] c.o.ocp.core.property.PropertyService : Refresh config properties done 2024-12-31 18:19:50.481 WARN 34018 --- [ocp-async-3,84f3cfc186d13d95,a5a2b841c8bbe47c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:19:50.482 INFO 34018 --- [ocp-async-1,c3b6886daa647968,fd28ba096079d79d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:19:51.803 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:19:51.806 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:19:51.890 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:19:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:19:52.482 WARN 34018 --- [ocp-async-2,e00ddb95981cc900,bd0a6f0ecede6150] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:19:52.482 INFO 34018 --- [ocp-async-8,73ec2fd0033c7d38,714e4009f3383c6a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:19:54.482 WARN 34018 --- [ocp-async-7,871fe8c9ea4796d8,dfc80b99e9b34ba9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:19:54.483 INFO 34018 --- [ocp-async-6,22ba71c056321ebf,107a1201a7344dbc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:19:54.806 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:19:54.808 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:19:56.151 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,,] o.a.c.c.C.[Tomcat].[localhost].[/] : Initializing Spring DispatcherServlet 'dispatcherServlet' 2024-12-31 18:19:56.151 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,,] o.s.web.servlet.DispatcherServlet : Initializing Servlet 'dispatcherServlet' 2024-12-31 18:19:56.158 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,,] o.s.web.servlet.DispatcherServlet : Completed initialization in 7 ms 2024-12-31 18:19:56.482 WARN 34018 --- [ocp-async-6,3104ae657b19cddd,a187d63df986d4c9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:19:56.483 INFO 34018 --- [ocp-async-5,36a0698d9dd45e75,d2ca9935b0cccbfe] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:19:56.627 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,8a77568baf54abca,34c737193e776f97] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=10.79.169.37, traceId=8a77568baf54abca, method=OffsetDateTime com.oceanbase.ocp.server.common.controller.InfoController.time(), args=] 2024-12-31 18:19:56.631 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,8a77568baf54abca,34c737193e776f97] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=10.79.169.37, traceId=8a77568baf54abca, duration=432 ms] 2024-12-31 18:19:56.761 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,9625b0798270bcf1,dd089b9adaaf3099] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=10.79.169.37, traceId=9625b0798270bcf1, method=OffsetDateTime com.oceanbase.ocp.server.common.controller.InfoController.time(), args=] 2024-12-31 18:19:56.762 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,9625b0798270bcf1,dd089b9adaaf3099] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=10.79.169.37, traceId=9625b0798270bcf1, duration=15 ms] 2024-12-31 18:19:57.808 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:19:57.811 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:19:58.482 INFO 34018 --- [ocp-async-2,bfdc8504b917e67a,86f1d2173d39af86] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:19:58.483 WARN 34018 --- [ocp-async-1,db58cdc339600f44,17d887bd7649b567] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:19:58.483 INFO 34018 --- [ocp-async-7,c20c72d729f5af0a,14f30e0d1a772cc3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:19:58.496 INFO 34018 --- [ocp-schedules-7,fd962d7d4fc53916,89f8b299f5473624] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:20:00.483 WARN 34018 --- [ocp-async-7,bcf491b59808ef8c,254087b642da1894] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:00.484 INFO 34018 --- [ocp-async-3,f813945146306e0c,4ea016f6a4c321e1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:00.811 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:00.813 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:01.010 INFO 34018 --- [task-coordinator1,93cfe403787200b1,dc9c23a3420fe233] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2024-12-31 18:20:00.0, currentDate=Tue Dec 31 18:20:01 CST 2024 2024-12-31 18:20:01.010 INFO 34018 --- [task-coordinator1,93cfe403787200b1,dc9c23a3420fe233] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999985, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=null, nextRunTime=2024-12-31 18:20:00.0} 2024-12-31 18:20:01.022 INFO 34018 --- [task-coordinator1,93cfe403787200b1,dc9c23a3420fe233] c.o.o.p.s.internal.SqlParseTaskSchedule : get Clusters for parse:[] 2024-12-31 18:20:01.103 INFO 34018 --- [task-coordinator1,93cfe403787200b1,dc9c23a3420fe233] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2024-12-31 18:20:01.104 INFO 34018 --- [task-coordinator1,93cfe403787200b1,dc9c23a3420fe233] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2024-12-31 18:20:02.483 WARN 34018 --- [ocp-async-6,8e690802fe8c04be,2f19b846c0d100e5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:02.484 INFO 34018 --- [ocp-async-1,e022b1a15dd08de8,75eeb10381651f89] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:03.634 INFO 34018 --- [part-initial-worker,,] c.o.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key part-worker 2024-12-31 18:20:03.636 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Monitordb 2024-12-31 18:20:03.643 INFO 34018 --- [part-initial-worker,,] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=null, obClusterId=null, tenantName=ocp_monitor, username=root, address=10.79.169.37, port=2881, database=monitor_database) 2024-12-31 18:20:03.643 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] create new ob connector, connectProperties=ConnectProperties(connectionMode=direct, address=10.79.169.37, port=2881, obsAddrList=null, username=root, tenantName=ocp_monitor, clusterName=null, obClusterId=null, proxy=null, odpSocketConfig=null, vpcId=1, compatibilityMode=MYSQL, database=monitor_database) 2024-12-31 18:20:03.662 INFO 34018 --- [obsdk-init-thread-1,9d7bdaa63f71f0cb,19abcb1b03cbba6a] com.alibaba.druid.pool.DruidDataSource : {dataSource-3,ob-connector-datasource_direct_ocp_monitor_root_10.79.169.37_2881} inited 2024-12-31 18:20:03.662 INFO 34018 --- [obsdk-init-thread-1,9d7bdaa63f71f0cb,19abcb1b03cbba6a] c.o.o.o.c.impl.AbstractConnector : [obsdk] init druid datasource success, poolingCount=1, connectProperties=ConnectProperties(connectionMode=direct, address=10.79.169.37, port=2881, obsAddrList=null, username=root, tenantName=ocp_monitor, clusterName=null, obClusterId=null, proxy=null, odpSocketConfig=null, vpcId=1, compatibilityMode=MYSQL, database=monitor_database) 2024-12-31 18:20:03.662 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] create new ob connector success 2024-12-31 18:20:03.677 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:03.678 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:20:03.690 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:03.691 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:20:03.693 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:03.694 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_0 2024-12-31 18:20:03.749 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20241229 2024-12-31 18:20:03.751 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:03.752 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:20:03.813 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:03.815 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:04.153 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:04.155 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2024-12-31 18:20:04.162 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:04.168 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:20:04.169 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:04.170 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:20:04.171 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2024-12-31 18:20:04.178 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=6ms, period=120000ms 2024-12-31 18:20:04.194 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=null, nextRun=2024-12-31 18:20:04.0, currentDate=Tue Dec 31 18:20:04 CST 2024 2024-12-31 18:20:04.195 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999999, name=Partitioning daemon, templateName=PartitioningDaemonSchedule, scheduleRule=4 */10 * * * *, lastRunTime=null, nextRunTime=2024-12-31 18:20:04.0} 2024-12-31 18:20:04.215 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Partition rollover daemon, nodeCount=1, taskCount=1 2024-12-31 18:20:04.217 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Partition rollover daemon', taskDefinitionId=999999, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.79.169.37', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2024-12-31T18:20:04.215+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Partition rollover daemon, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.service.partitioning.PartitioningDaemonSchedule$Task, seriesId=0, startTime=null, endTime=null}], template=null, traceId='93cfe403787200b1', operation=EXECUTE} 2024-12-31 18:20:04.373 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_0 2024-12-31 18:20:04.375 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20241230 2024-12-31 18:20:04.376 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:04.376 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:20:04.452 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Start cache subtask classes 2024-12-31 18:20:04.453 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Remote, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPostScriptTask$Remote, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McUpdateObClusterStatusTask$Remote 2024-12-31 18:20:04.453 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Remote, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McRecoverObParameterTask$Remote, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McUpdateObClusterStatusTask$Remote 2024-12-31 18:20:04.453 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=LocalStandby, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McEndUpgradeTask$LocalStandby, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPostScriptTask$LocalStandby 2024-12-31 18:20:04.453 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Remote, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McCleanUpgradeFilesTask$Remote, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McUpdateObClusterStatusTask$Remote 2024-12-31 18:20:04.453 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemotePrimarySenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McBeginUpgradeTask$RemotePrimarySenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPreScriptTask$RemotePrimarySenderTask 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Remote, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSyncClusterInfoTask$Remote, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McUpdateObClusterStatusTask$Remote 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteStandbySenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPostScriptTask$RemoteStandbySenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradePostCheckerScriptTask$RemoteStandbySenderTask 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=LocalStandby, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPreScriptTask$LocalStandby, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPostScriptTask$LocalStandby 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemotePrimarySenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McEndUpgradeTask$RemotePrimarySenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPreScriptTask$RemotePrimarySenderTask 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Local, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McPrepareUpgradeClusterTask$Local, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McBeginUpgradeTask$Local 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Local, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McRecoverObParameterTask$Local, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McBeginUpgradeTask$Local 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteSenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradePreScriptTask$RemoteSenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSyncClusterInfoTask$RemoteSenderTask 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteStandby, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPreScriptTask$RemoteStandby, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSetClusterContextTask$RemoteStandby 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Local, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeCheckerScriptTask$Local, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McBeginUpgradeTask$Local 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteStandbySenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPreScriptTask$RemoteStandbySenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradePostCheckerScriptTask$RemoteStandbySenderTask 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemotePrimarySenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradePostCheckerScriptTask$RemotePrimarySenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPreScriptTask$RemotePrimarySenderTask 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Local, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McCleanUpgradeFilesTask$Local, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McBeginUpgradeTask$Local 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Local, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McRecordObParameterTask$Local, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McBeginUpgradeTask$Local 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Remote, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McEndUpgradeTask$Remote, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McUpdateObClusterStatusTask$Remote 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Local, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McRootInspectTask$Local, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McBeginUpgradeTask$Local 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Remote, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McBeginUpgradeTask$Remote, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McUpdateObClusterStatusTask$Remote 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteSenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McPrepareUpgradeClusterTask$RemoteSenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSyncClusterInfoTask$RemoteSenderTask 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Local, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSyncClusterInfoTask$Local, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McBeginUpgradeTask$Local 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Remote, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McRecordObParameterTask$Remote, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McUpdateObClusterStatusTask$Remote 2024-12-31 18:20:04.454 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Local, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McUpdateObClusterStatusTask$Local, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McBeginUpgradeTask$Local 2024-12-31 18:20:04.455 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=LocalStandby, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradePostCheckerScriptTask$LocalStandby, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPostScriptTask$LocalStandby 2024-12-31 18:20:04.455 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=LocalPrimary, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McEndUpgradeTask$LocalPrimary, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPostScriptTask$LocalPrimary 2024-12-31 18:20:04.455 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemotePrimarySenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPostScriptTask$RemotePrimarySenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPreScriptTask$RemotePrimarySenderTask 2024-12-31 18:20:04.455 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Remote, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeCheckerScriptTask$Remote, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McUpdateObClusterStatusTask$Remote 2024-12-31 18:20:04.455 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteSenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradePostScriptTask$RemoteSenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSyncClusterInfoTask$RemoteSenderTask 2024-12-31 18:20:04.455 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteStandbySenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McEndUpgradeTask$RemoteStandbySenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradePostCheckerScriptTask$RemoteStandbySenderTask 2024-12-31 18:20:04.455 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteSenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McRootInspectTask$RemoteSenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSyncClusterInfoTask$RemoteSenderTask 2024-12-31 18:20:04.455 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteSenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McRecordObParameterTask$RemoteSenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSyncClusterInfoTask$RemoteSenderTask 2024-12-31 18:20:04.455 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteStandbySenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McBeginUpgradeTask$RemoteStandbySenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradePostCheckerScriptTask$RemoteStandbySenderTask 2024-12-31 18:20:04.455 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=LocalPrimary, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradePostCheckerScriptTask$LocalPrimary, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPostScriptTask$LocalPrimary 2024-12-31 18:20:04.456 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteSenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McUpdateObClusterStatusTask$RemoteSenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSyncClusterInfoTask$RemoteSenderTask 2024-12-31 18:20:04.456 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteSenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McRecoverObParameterTask$RemoteSenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSyncClusterInfoTask$RemoteSenderTask 2024-12-31 18:20:04.456 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Remote, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradePostCheckerScriptTask$Remote, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McUpdateObClusterStatusTask$Remote 2024-12-31 18:20:04.456 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteSenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeCheckerScriptTask$RemoteSenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSyncClusterInfoTask$RemoteSenderTask 2024-12-31 18:20:04.456 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Remote, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McRootInspectTask$Remote, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McUpdateObClusterStatusTask$Remote 2024-12-31 18:20:04.456 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=LocalStandby, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSetClusterContextTask$LocalStandby, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPostScriptTask$LocalStandby 2024-12-31 18:20:04.456 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Primary, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeRollingPreScriptTask$Primary, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSetClusterContextTask$Primary 2024-12-31 18:20:04.456 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=Remote, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McPrepareUpgradeClusterTask$Remote, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McUpdateObClusterStatusTask$Remote 2024-12-31 18:20:04.456 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteSenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McExecUpgradeClusterHealthCheckerScriptTask$RemoteSenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSyncClusterInfoTask$RemoteSenderTask 2024-12-31 18:20:04.456 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=RemoteSenderTask, class=com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McCleanUpgradeFilesTask$RemoteSenderTask, existClass=class com.oceanbase.ocp.service.task.business.mc.operation.ob.upgrade.McSyncClusterInfoTask$RemoteSenderTask 2024-12-31 18:20:04.456 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask simple name already exist, remove exist info. SimpleName=UpdateObClusterStatusTask, class=com.oceanbase.ocp.obops.internal.cluster.task.UpdateObClusterStatusTask, existClass=class com.oceanbase.ocp.service.task.business.host.UpdateObClusterStatusTask 2024-12-31 18:20:04.458 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Remove duplicated simple name cache, size=46 2024-12-31 18:20:04.458 INFO 34018 --- [task-coordinator1,93cfe403787200b1,fb85af1f317dd6d0] c.o.o.c.t.engine.util.SubtaskClassCache : Subtask cache initialized, simpleNameSize=536, classNameSize=592 2024-12-31 18:20:04.484 WARN 34018 --- [ocp-async-10,66115c29639ba6cc,215441167236e5be] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:04.484 INFO 34018 --- [ocp-async-8,74f308238b59c8d7,b94d85da86e5065a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:04.739 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:04.740 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2024-12-31 18:20:04.794 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_0 2024-12-31 18:20:04.797 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20241231 2024-12-31 18:20:04.797 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:04.798 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:20:05.168 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:05.169 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2024-12-31 18:20:05.170 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,132ee1c81d0c141f] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1, operation:EXECUTE, state: RUNNING 2024-12-31 18:20:05.221 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_0 2024-12-31 18:20:05.222 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20250101 2024-12-31 18:20:05.223 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:05.224 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:20:05.230 INFO 34018 --- [subtask-executor1,93cfe403787200b1,7cade70c5c6d5f37] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=1, context=Context{parallelIdx=-1, stringMap={task_instance_id=1, task_operation=execute, latest_execution_start_time=2024-12-31T18:20:05.149+08:00, sub_task_instance_name=Partition rollover daemon, sub_task_instance_id=1}, listMap={}}, executor=10.79.169.37 2024-12-31 18:20:05.603 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:05.605 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2024-12-31 18:20:05.647 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_0 2024-12-31 18:20:05.648 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20250102 2024-12-31 18:20:05.649 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:05.649 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:20:06.033 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:06.035 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2024-12-31 18:20:06.076 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_0 2024-12-31 18:20:06.078 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20250103 2024-12-31 18:20:06.079 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:06.080 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:20:06.429 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:06.431 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2024-12-31 18:20:06.470 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_0 2024-12-31 18:20:06.472 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20250104 2024-12-31 18:20:06.472 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:06.473 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:20:06.484 WARN 34018 --- [ocp-async-7,996dabeb7324ee56,c6870d04b87396bd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:06.485 INFO 34018 --- [ocp-async-9,ee1f158c9c39a84b,74ea384bbd39ace4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:06.815 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:06.818 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:06.868 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:06.870 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2024-12-31 18:20:06.916 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_0 2024-12-31 18:20:06.917 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20250105 2024-12-31 18:20:06.918 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:06.919 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:20:07.322 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:07.324 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2024-12-31 18:20:07.368 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_0 2024-12-31 18:20:07.369 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20250106 2024-12-31 18:20:07.370 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:07.371 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:20:07.772 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:07.774 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2024-12-31 18:20:07.820 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_0 2024-12-31 18:20:07.821 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20250107 2024-12-31 18:20:07.822 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:07.823 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:20:08.221 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:08.223 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2024-12-31 18:20:08.269 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_0 2024-12-31 18:20:08.271 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_0, partition=P20250108 2024-12-31 18:20:08.272 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:08.272 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_0` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:20:08.482 INFO 34018 --- [ocp-async-3,6d24250284f7aa69,e05ba0311e11760e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:20:08.485 WARN 34018 --- [ocp-async-5,c9fb02f86a531cde,5e471e34e8947e6f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:08.485 INFO 34018 --- [ocp-async-1,c11bbd364294d3a3,565fba9714f275e2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:08.496 INFO 34018 --- [ocp-schedules-29,aa764bd09e277786,78fe2456027573be] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:20:08.678 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:08.679 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_0' and table_type='BASE TABLE' 2024-12-31 18:20:08.718 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_0 2024-12-31 18:20:08.721 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:08.721 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:20:08.722 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:08.722 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_1 2024-12-31 18:20:08.747 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20241223 2024-12-31 18:20:08.747 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:08.748 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20241223 values less than (1734998400000000)) 2024-12-31 18:20:08.992 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:08.993 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:09.031 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:09.033 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20241224 2024-12-31 18:20:09.033 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:09.034 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20241224 values less than (1735084800000000)) 2024-12-31 18:20:09.303 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:09.305 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:09.350 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:09.351 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20241225 2024-12-31 18:20:09.352 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:09.353 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20241225 values less than (1735171200000000)) 2024-12-31 18:20:09.643 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:09.645 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:09.687 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:09.688 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20241226 2024-12-31 18:20:09.689 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:09.690 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:20:09.818 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:09.820 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:09.965 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:09.967 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:10.007 INFO 34018 --- [ocp-schedules-20,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:20:10.007 INFO 34018 --- [ocp-schedules-30,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:20:10.013 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:10.014 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20241227 2024-12-31 18:20:10.015 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:10.016 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:20:10.298 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:10.300 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:10.378 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:10.379 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20241228 2024-12-31 18:20:10.380 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:10.380 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:20:10.485 WARN 34018 --- [ocp-async-1,41de4c930dc809ca,30a3b32485c55b02] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:10.487 INFO 34018 --- [ocp-async-8,fc21e91a67b1be52,df15925272026e93] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:10.654 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:10.656 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:10.696 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:10.697 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20241229 2024-12-31 18:20:10.698 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:10.699 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:20:10.890 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-12-31 18:20:10.908 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-12-31 18:20:10.950 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:10.952 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:10.989 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:10.990 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20241230 2024-12-31 18:20:10.991 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:10.992 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:20:11.266 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:11.268 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:11.311 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:11.313 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20241231 2024-12-31 18:20:11.314 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:11.314 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:20:11.382 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,bc77c304687569b0,d78116015ead1cec] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /pre_login_loading?null, client=10.108.139.108, traceId=bc77c304687569b0, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.WebController.preLoginLoading(), args=] 2024-12-31 18:20:11.390 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,bc77c304687569b0,d78116015ead1cec] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /pre_login_loading client=10.108.139.108, traceId=bc77c304687569b0, duration=45 ms] 2024-12-31 18:20:11.580 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:11.581 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:11.616 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:11.617 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20250101 2024-12-31 18:20:11.617 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:11.618 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:20:11.867 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:11.869 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:11.904 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:11.905 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20250102 2024-12-31 18:20:11.906 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:11.907 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:20:12.188 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:12.189 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:12.228 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:12.229 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20250103 2024-12-31 18:20:12.229 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:12.230 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:20:12.485 WARN 34018 --- [ocp-async-2,5a22ea667643e47c,2812a3b702da611f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:12.485 INFO 34018 --- [ocp-async-7,c54833d0e6208293,ffa113d4716ed083] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:12.510 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:12.511 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:12.550 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:12.551 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20250104 2024-12-31 18:20:12.551 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:12.552 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:20:12.568 INFO 34018 --- [prometheus-minute-schedule-1,820a268fabe330a5,a31b1d38add5d894] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:12.569 INFO 34018 --- [prometheus-hour-schedule-1,aa65bd704dd11a62,aed944b1cd2db456] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:20:12.820 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:12.822 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:12.824 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:12.825 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:12.860 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:12.861 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20250105 2024-12-31 18:20:12.862 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:12.863 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:20:13.290 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:13.292 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:13.332 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:13.332 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20250106 2024-12-31 18:20:13.333 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:13.334 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:20:13.615 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:13.616 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:13.732 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:13.733 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20250107 2024-12-31 18:20:13.733 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:13.734 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:20:14.014 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:14.016 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:14.061 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:14.062 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_1, partition=P20250108 2024-12-31 18:20:14.063 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:14.064 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_1` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:20:14.348 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:14.349 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_1' and table_type='BASE TABLE' 2024-12-31 18:20:14.390 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_1 2024-12-31 18:20:14.392 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:14.393 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:20:14.393 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:14.394 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_2 2024-12-31 18:20:14.439 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241216 2024-12-31 18:20:14.440 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:14.440 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241216 values less than (1734393600000000)) 2024-12-31 18:20:14.486 WARN 34018 --- [ocp-async-5,c85ca69488b301ee,0b169e3abb01b210] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:14.486 INFO 34018 --- [ocp-async-7,bf416cc3d58d1458,4d0cd554b18a6508] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:14.769 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:14.771 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:14.814 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:14.815 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241217 2024-12-31 18:20:14.816 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:14.817 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241217 values less than (1734480000000000)) 2024-12-31 18:20:15.172 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:15.174 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:15.218 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:15.220 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241218 2024-12-31 18:20:15.220 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:15.221 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241218 values less than (1734566400000000)) 2024-12-31 18:20:15.232 WARN 34018 --- [subtask-executor1,93cfe403787200b1,7cade70c5c6d5f37] c.o.o.c.d.lock.jdbc.DefaultLockManager : LockException while executing with jdbc lock part-worker Cannot acquire lock for key part-worker 2024-12-31 18:20:15.238 ERROR 34018 --- [subtask-executor1,93cfe403787200b1,7cade70c5c6d5f37] c.o.o.c.t.e.c.w.subtask.SubtaskExecutor : Cannot acquire lock for key part-worker com.oceanbase.ocp.core.distributed.lock.LockException: Cannot acquire lock for key part-worker at com.oceanbase.ocp.core.distributed.lock.jdbc.DefaultLockManager.doExecuteWhileLocked(DefaultLockManager.java:97) at com.oceanbase.ocp.core.distributed.lock.jdbc.DefaultLockManager.executeWhileLocked(DefaultLockManager.java:81) at com.oceanbase.ocp.service.partitioning.PartitionRolloverService.watchAllWhileLocked(PartitionRolloverService.java:121) at com.oceanbase.ocp.service.partitioning.PartitioningDaemonSchedule$Task.run(PartitioningDaemonSchedule.java:48) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.execute(JavaSubtaskRunner.java:64) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.doRun(JavaSubtaskRunner.java:32) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.run(JavaSubtaskRunner.java:26) at com.oceanbase.ocp.core.task.engine.runner.RunnerFactory.doRun(RunnerFactory.java:76) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.doRun(SubtaskExecutor.java:206) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.redirectConsoleOutput(SubtaskExecutor.java:191) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.lambda$submit$2(SubtaskExecutor.java:137) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-12-31 18:20:15.253 INFO 34018 --- [subtask-executor1,93cfe403787200b1,7cade70c5c6d5f37] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 1, operation:EXECUTE, state: FAILED 2024-12-31 18:20:15.568 INFO 34018 --- [prometheus-minute-schedule-1,f92eafef1705dd69,098c83a5d0370613] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:15.592 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:15.594 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:15.635 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:15.636 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241219 2024-12-31 18:20:15.637 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:15.638 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241219 values less than (1734652800000000)) 2024-12-31 18:20:15.823 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:15.824 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:16.006 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:16.007 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:16.042 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:16.043 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241220 2024-12-31 18:20:16.043 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:16.044 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241220 values less than (1734739200000000)) 2024-12-31 18:20:16.123 INFO 34018 --- [task-coordinator3,,] c.o.o.c.t.e.c.worker.RunningTaskWorker : Mark failed task, entity=TaskInstanceEntity{id=1, name='Partition rollover daemon', taskDefinitionId=999999, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.79.169.37', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=2024-12-31T18:20:04+08:00, startTime=2024-12-31T18:20:04.215+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=1, name=Partition rollover daemon, state=FAILED, operation=EXECUTE, className=com.oceanbase.ocp.service.partitioning.PartitioningDaemonSchedule$Task, seriesId=0, startTime=2024-12-31T18:20:05.150+08:00, endTime=2024-12-31T18:20:15.239+08:00}], template=null, traceId='93cfe403787200b1', operation=EXECUTE} 2024-12-31 18:20:16.144 INFO 34018 --- [task-coordinator3,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:1, status:FAILED 2024-12-31 18:20:16.168 INFO 34018 --- [task-coordinator3,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:1, status:FAILED 2024-12-31 18:20:16.289 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,92ca9a4e98e4a72d,b6f9fa0fa4bee173] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/authInfo?null, client=10.108.139.108, traceId=92ca9a4e98e4a72d, method=SuccessResponse com.oceanbase.ocp.server.common.controller.InfoController.getAuthInfo(), args=] 2024-12-31 18:20:16.360 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,92ca9a4e98e4a72d,b6f9fa0fa4bee173] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/authInfo client=10.108.139.108, traceId=92ca9a4e98e4a72d, duration=92 ms] 2024-12-31 18:20:16.395 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:16.396 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:16.428 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:16.429 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241221 2024-12-31 18:20:16.430 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:16.430 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241221 values less than (1734825600000000)) 2024-12-31 18:20:16.482 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,1ecedea777ac909f,6b8f09d75518b094] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /favicon.ico?null, client=10.108.139.108, traceId=1ecedea777ac909f, method=void com.oceanbase.ocp.server.common.controller.web.WebController.dummyFavicon(), args=] 2024-12-31 18:20:16.484 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,1ecedea777ac909f,6b8f09d75518b094] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /favicon.ico client=10.108.139.108, traceId=1ecedea777ac909f, duration=8 ms] 2024-12-31 18:20:16.486 WARN 34018 --- [ocp-async-3,2a5c04c0800903f4,f6ee2532fca72581] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:16.486 INFO 34018 --- [ocp-async-10,2c07cf720734f455,380ac3a99d0480ce] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:16.668 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,2b466bb51dfed423,ec0ff2aa872c3b92] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /favicon.ico?null, client=10.108.139.108, traceId=2b466bb51dfed423, method=void com.oceanbase.ocp.server.common.controller.web.WebController.dummyFavicon(), args=] 2024-12-31 18:20:16.668 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,2b466bb51dfed423,ec0ff2aa872c3b92] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /favicon.ico client=10.108.139.108, traceId=2b466bb51dfed423, duration=5 ms] 2024-12-31 18:20:16.781 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:16.783 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:16.817 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:16.818 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241222 2024-12-31 18:20:16.819 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:16.819 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241222 values less than (1734912000000000)) 2024-12-31 18:20:17.190 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:17.191 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:17.226 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:17.227 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241223 2024-12-31 18:20:17.228 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:17.228 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241223 values less than (1734998400000000)) 2024-12-31 18:20:17.608 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:17.610 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:17.649 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:17.650 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241224 2024-12-31 18:20:17.650 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:17.651 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241224 values less than (1735084800000000)) 2024-12-31 18:20:17.824 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,b55c6ad184e9ba58,5a1a6a025d61b19f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/authInfo?null, client=10.108.139.108, traceId=b55c6ad184e9ba58, method=SuccessResponse com.oceanbase.ocp.server.common.controller.InfoController.getAuthInfo(), args=] 2024-12-31 18:20:17.828 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,b55c6ad184e9ba58,5a1a6a025d61b19f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/authInfo client=10.108.139.108, traceId=b55c6ad184e9ba58, duration=12 ms] 2024-12-31 18:20:18.022 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:18.024 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:18.064 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:18.065 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241225 2024-12-31 18:20:18.066 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:18.067 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241225 values less than (1735171200000000)) 2024-12-31 18:20:18.458 INFO 34018 --- [ocp-schedules-30,57af3ef5bbba7fc6,4b841a8cc00e0327] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:20:18.458 INFO 34018 --- [ocp-schedules-24,d522cb7fa820278e,aff253560d41a909] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:20:18.458 INFO 34018 --- [ocp-schedules-4,98dca9607d7b634e,d7b4658e19284778] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:20:18.459 INFO 34018 --- [ocp-schedules-6,541196e6c7e4efab,59207aca374aacd7] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:20:18.459 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:18.461 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:18.465 INFO 34018 --- [ocp-schedules-26,c2ea50bdf7fd7a40,777ae6b4297bdd47] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:20:18.483 INFO 34018 --- [ocp-async-4,a30d5d54223019fb,754a03cd80c44e5e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:20:18.488 WARN 34018 --- [ocp-async-9,88f348bcc484e7fe,b380c0164945797b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:18.488 INFO 34018 --- [ocp-async-8,2fa7c4f8fde21cbd,e8408a66a59cae03] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:18.496 INFO 34018 --- [ocp-schedules-14,7ff55cd45f725ee5,3ac8a556b46c2d04] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:20:18.506 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:18.508 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241226 2024-12-31 18:20:18.508 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:18.509 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:20:18.519 INFO 34018 --- [ocp-schedules-16,2e8b91d08cf55871,ebcac5a3215a47b3] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:20:18.568 INFO 34018 --- [prometheus-minute-schedule-1,31e1fde1a25aa35d,27607dac846eca47] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:18.758 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=10.108.139.108, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2024-12-31 18:20:18.762 WARN 34018 --- [http-nio-0.0.0.0-8090-exec-1,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/mc/info, method=10.108.139.108, client=GET, traceId=] 2024-12-31 18:20:18.762 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=10.108.139.108, traceId=, duration=0 ms] 2024-12-31 18:20:18.825 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:18.826 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:18.963 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:18.965 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:19.008 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:19.010 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241227 2024-12-31 18:20:19.011 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:19.011 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:20:19.378 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:19.380 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:19.426 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:19.427 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241228 2024-12-31 18:20:19.428 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:19.429 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:20:19.783 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:19.785 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:19.826 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:19.828 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241229 2024-12-31 18:20:19.828 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:19.829 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:20:20.202 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:20.204 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:20.244 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:20.245 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241230 2024-12-31 18:20:20.246 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:20.246 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:20:20.489 WARN 34018 --- [ocp-async-7,bdc1280b9ed3a178,a2b8747e4016b34c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:20.489 INFO 34018 --- [ocp-async-6,87b58bd9d1908712,4c9c477ec46ca682] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:20.653 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:20.655 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:20.703 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:20.704 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20241231 2024-12-31 18:20:20.705 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:20.706 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:20:21.106 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:21.107 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:21.146 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:21.147 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20250101 2024-12-31 18:20:21.148 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:21.149 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:20:21.539 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:21.541 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:21.568 INFO 34018 --- [prometheus-minute-schedule-1,4acb90401b589ec2,31ad3ee669a95821] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:21.585 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:21.586 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20250102 2024-12-31 18:20:21.587 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:21.588 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:20:21.826 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:21.829 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:21.985 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:21.987 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:22.029 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:22.030 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20250103 2024-12-31 18:20:22.031 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:22.032 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:20:22.413 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:22.414 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:22.460 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:22.462 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20250104 2024-12-31 18:20:22.462 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:22.463 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:20:22.489 INFO 34018 --- [ocp-async-3,ca231a3d14d958e4,7fca7c289c0c3dbc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:22.489 WARN 34018 --- [ocp-async-10,92420320de10f3ab,026d3e8623954a65] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:22.875 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:22.876 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:22.915 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:22.916 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20250105 2024-12-31 18:20:22.917 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:22.918 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:20:23.290 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:23.292 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:23.339 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:23.341 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20250106 2024-12-31 18:20:23.342 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:23.343 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:20:23.735 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:23.737 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:23.783 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:23.784 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20250107 2024-12-31 18:20:23.785 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:23.786 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:20:24.171 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:24.173 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:24.212 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:24.213 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat_2, partition=P20250108 2024-12-31 18:20:24.214 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:24.215 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat_2` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:20:24.489 WARN 34018 --- [ocp-async-4,1c36fc6474c8d383,1b73e0bcff489412] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:24.489 INFO 34018 --- [ocp-async-9,1d25f7f98ecb9798,0e7c45231e15ce65] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:24.568 INFO 34018 --- [prometheus-minute-schedule-1,f7daee75053a6f26,8b171c634db2fcdb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:24.598 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:24.600 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat_2' and table_type='BASE TABLE' 2024-12-31 18:20:24.642 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat_2 2024-12-31 18:20:24.644 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:24.644 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:20:24.645 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:24.645 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat 2024-12-31 18:20:24.679 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241201 2024-12-31 18:20:24.680 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:24.681 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241201 values less than (1733097600000000)) 2024-12-31 18:20:24.829 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:24.831 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:24.925 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:24.927 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:24.969 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:24.971 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241202 2024-12-31 18:20:24.971 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:24.972 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241202 values less than (1733184000000000)) 2024-12-31 18:20:25.252 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:25.253 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:25.287 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:25.288 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241203 2024-12-31 18:20:25.289 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:25.290 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241203 values less than (1733270400000000)) 2024-12-31 18:20:25.565 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:25.567 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:25.607 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:25.608 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241204 2024-12-31 18:20:25.609 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:25.610 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241204 values less than (1733356800000000)) 2024-12-31 18:20:25.887 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:25.889 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:25.930 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:25.932 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241205 2024-12-31 18:20:25.932 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:25.933 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241205 values less than (1733443200000000)) 2024-12-31 18:20:26.224 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:26.226 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:26.272 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:26.274 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241206 2024-12-31 18:20:26.275 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:26.276 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241206 values less than (1733529600000000)) 2024-12-31 18:20:26.489 WARN 34018 --- [ocp-async-8,2f55ebf2096cd4a3,33e90e4541a5c999] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:26.489 INFO 34018 --- [ocp-async-9,25e29e090542d61d,dff9091feb89e860] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:26.556 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:26.558 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:26.604 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:26.606 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241207 2024-12-31 18:20:26.607 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:26.608 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241207 values less than (1733616000000000)) 2024-12-31 18:20:26.904 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:26.906 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:26.950 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:26.951 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241208 2024-12-31 18:20:26.952 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:26.953 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241208 values less than (1733702400000000)) 2024-12-31 18:20:27.206 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:27.208 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:27.250 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:27.251 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241209 2024-12-31 18:20:27.252 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:27.252 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241209 values less than (1733788800000000)) 2024-12-31 18:20:27.528 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:27.529 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:27.563 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:27.564 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241210 2024-12-31 18:20:27.565 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:27.565 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241210 values less than (1733875200000000)) 2024-12-31 18:20:27.568 INFO 34018 --- [prometheus-minute-schedule-1,cb01829a43f6a834,205742e4253b7286] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:27.831 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:27.833 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:27.842 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:27.845 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:27.887 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:27.888 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241211 2024-12-31 18:20:27.889 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:27.890 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241211 values less than (1733961600000000)) 2024-12-31 18:20:28.252 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:28.254 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:28.295 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:28.297 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241212 2024-12-31 18:20:28.297 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:28.298 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241212 values less than (1734048000000000)) 2024-12-31 18:20:28.483 INFO 34018 --- [ocp-async-6,96b70109bf903fe7,71b134df8fc8471d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:20:28.489 INFO 34018 --- [ocp-async-1,e2dfcb4d22baf4a6,ab8a08fe35e126a7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:28.490 WARN 34018 --- [ocp-async-3,ba2af5d6ed0922a4,425e0609c13530ab] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:28.496 INFO 34018 --- [ocp-schedules-10,aa8520f5244dbca6,d1ee15c99e946cf8] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:20:28.593 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:28.594 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:28.640 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:28.641 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241213 2024-12-31 18:20:28.642 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:28.643 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241213 values less than (1734134400000000)) 2024-12-31 18:20:28.927 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:28.929 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:28.967 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:28.968 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241214 2024-12-31 18:20:28.969 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:28.969 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241214 values less than (1734220800000000)) 2024-12-31 18:20:29.288 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:29.289 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:29.332 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:29.333 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241215 2024-12-31 18:20:29.334 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:29.335 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241215 values less than (1734307200000000)) 2024-12-31 18:20:29.355 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,3359506e89a7ff06,79de205f3a47e373] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/sensitiveDataKey?null, client=10.108.139.108, traceId=3359506e89a7ff06, method=SuccessResponse com.oceanbase.ocp.server.common.controller.InfoController.getSensitiveDataPublicKey(), args=] 2024-12-31 18:20:29.355 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,3359506e89a7ff06,79de205f3a47e373] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/sensitiveDataKey client=10.108.139.108, traceId=3359506e89a7ff06, duration=9 ms] 2024-12-31 18:20:29.586 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,51832e1e626803e5,77c4c859af63edb3] c.c.s.h.OcpAuthenticationSuccessListener : User[name=admin, origin=LOCAL] authenticated successes. 2024-12-31 18:20:29.605 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,51832e1e626803e5,77c4c859af63edb3] c.s.h.CustomAuthenticationSuccessHandler : Authentication successful for /api/v2/iam/login 2024-12-31 18:20:29.612 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:29.613 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,51832e1e626803e5,77c4c859af63edb3] c.s.h.CustomAuthenticationSuccessHandler : Redirecting to saved url: / 2024-12-31 18:20:29.614 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:29.647 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:29.648 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241216 2024-12-31 18:20:29.649 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:29.650 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241216 values less than (1734393600000000)) 2024-12-31 18:20:29.911 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:29.914 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:29.955 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:29.956 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241217 2024-12-31 18:20:29.957 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:29.958 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241217 values less than (1734480000000000)) 2024-12-31 18:20:30.302 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:30.304 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:30.342 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:30.343 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241218 2024-12-31 18:20:30.344 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:30.344 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241218 values less than (1734566400000000)) 2024-12-31 18:20:30.490 WARN 34018 --- [ocp-async-1,1dab69dac42e2e08,ea88a59a1254066c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:30.490 INFO 34018 --- [ocp-async-5,42f60d51968d33cc,dbbc8592a6cc6421] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:30.568 INFO 34018 --- [prometheus-minute-schedule-1,14802f9e2ce8ac7c,732206dee6bbd57f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:30.627 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:30.629 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:30.677 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:30.678 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241219 2024-12-31 18:20:30.679 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:30.680 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241219 values less than (1734652800000000)) 2024-12-31 18:20:30.834 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:30.836 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:30.956 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:30.959 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:31.002 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:31.004 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241220 2024-12-31 18:20:31.004 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:31.005 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241220 values less than (1734739200000000)) 2024-12-31 18:20:31.077 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,6a6b3835aeb2a559,6f746789a0e508c9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=10.108.139.108, traceId=6a6b3835aeb2a559, method=SuccessResponse com.oceanbase.ocp.server.common.controller.PropertyController.getSystemInfo(), args=] 2024-12-31 18:20:31.077 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,22a32de29e430ffe,8ae50d07baf6c7a6] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=10.108.139.108, traceId=22a32de29e430ffe, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ProfileController.userInfo(), args=] 2024-12-31 18:20:31.086 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,6a6b3835aeb2a559,6f746789a0e508c9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=10.108.139.108, traceId=6a6b3835aeb2a559, duration=20 ms] 2024-12-31 18:20:31.153 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,22a32de29e430ffe,8ae50d07baf6c7a6] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=10.108.139.108, traceId=22a32de29e430ffe, duration=87 ms] 2024-12-31 18:20:31.336 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:31.337 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:31.341 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,284fa1236f302d21,3c0eacbcc1817f0f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/telemetry?null, client=10.108.139.108, traceId=284fa1236f302d21, method=SuccessResponse com.oceanbase.ocp.controller.TelemetryController.get(), args=] 2024-12-31 18:20:31.352 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,284fa1236f302d21,3c0eacbcc1817f0f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/telemetry client=10.108.139.108, traceId=284fa1236f302d21, duration=22 ms] 2024-12-31 18:20:31.376 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:31.377 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241221 2024-12-31 18:20:31.378 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:31.378 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241221 values less than (1734825600000000)) 2024-12-31 18:20:31.661 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:31.662 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:31.705 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:31.706 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241222 2024-12-31 18:20:31.707 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:31.708 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241222 values less than (1734912000000000)) 2024-12-31 18:20:31.985 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:31.987 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:32.027 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:32.028 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241223 2024-12-31 18:20:32.029 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:32.030 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241223 values less than (1734998400000000)) 2024-12-31 18:20:32.116 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,e83f09343fdae84f,95090e1d8f969848] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/alarm/alarms/actived?null, client=10.108.139.108, traceId=e83f09343fdae84f, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.AlarmController.fetchActivedAlarms(String,String,List,String,List,List,List,OffsetDateTime,OffsetDateTime,String,Pageable), args=Page request [number: 0, size 10, sort: id: DESC],] 2024-12-31 18:20:32.303 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:32.304 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:32.339 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:32.340 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241224 2024-12-31 18:20:32.340 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:32.341 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241224 values less than (1735084800000000)) 2024-12-31 18:20:32.490 WARN 34018 --- [ocp-async-8,e4b87cfaca8c85c9,73d10e9e2c0de8af] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:32.490 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,e83f09343fdae84f,95090e1d8f969848] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/alarms/actived client=10.108.139.108, traceId=e83f09343fdae84f, duration=432 ms] 2024-12-31 18:20:32.490 INFO 34018 --- [ocp-async-9,c3400cd587d10238,4aded52a63a817b1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:32.608 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:32.610 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:32.648 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:32.649 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241225 2024-12-31 18:20:32.649 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:32.650 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241225 values less than (1735171200000000)) 2024-12-31 18:20:32.928 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:32.929 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:32.963 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:32.964 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241226 2024-12-31 18:20:32.965 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:32.965 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:20:33.241 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:33.242 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:33.280 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:33.281 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241227 2024-12-31 18:20:33.281 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:33.282 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:20:33.569 INFO 34018 --- [prometheus-minute-schedule-1,364e0fb2b94b3e77,288343c6557e275f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:33.569 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:33.571 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:33.619 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:33.621 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241228 2024-12-31 18:20:33.622 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:33.623 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:20:33.785 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,3b7915f812518a83,db8ab1d23dcf22d2] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/sensitiveDataKey?null, client=10.108.139.108, traceId=3b7915f812518a83, method=SuccessResponse com.oceanbase.ocp.server.common.controller.InfoController.getSensitiveDataPublicKey(), args=] 2024-12-31 18:20:33.785 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,43c3609c86f21347,56d8d40abc4134a5] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/info?null, client=10.108.139.108, traceId=43c3609c86f21347, method=OcpBuildInfo com.oceanbase.ocp.server.common.controller.InfoController.info(), args=] 2024-12-31 18:20:33.786 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,3b7915f812518a83,db8ab1d23dcf22d2] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/sensitiveDataKey client=10.108.139.108, traceId=3b7915f812518a83, duration=11 ms] 2024-12-31 18:20:33.787 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,43c3609c86f21347,56d8d40abc4134a5] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/info client=10.108.139.108, traceId=43c3609c86f21347, duration=10 ms] 2024-12-31 18:20:33.787 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,d0229e499e91b0fd,baf55223cd4cb4c5] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=10.108.139.108, traceId=d0229e499e91b0fd, method=OffsetDateTime com.oceanbase.ocp.server.common.controller.InfoController.time(), args=] 2024-12-31 18:20:33.788 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,d0229e499e91b0fd,baf55223cd4cb4c5] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=10.108.139.108, traceId=d0229e499e91b0fd, duration=10 ms] 2024-12-31 18:20:33.836 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:33.838 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:33.906 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:33.908 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:33.946 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:33.947 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241229 2024-12-31 18:20:33.948 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:33.949 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:20:33.967 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=10.108.139.108, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2024-12-31 18:20:33.967 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=10.108.139.108, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2024-12-31 18:20:33.967 WARN 34018 --- [http-nio-0.0.0.0-8090-exec-7,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/maz/state, method=10.108.139.108, client=GET, traceId=] 2024-12-31 18:20:33.967 WARN 34018 --- [http-nio-0.0.0.0-8090-exec-2,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/mc/info, method=10.108.139.108, client=GET, traceId=] 2024-12-31 18:20:33.967 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=10.108.139.108, traceId=, duration=0 ms] 2024-12-31 18:20:33.967 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=10.108.139.108, traceId=, duration=0 ms] 2024-12-31 18:20:34.299 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:34.301 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:34.344 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:34.345 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241230 2024-12-31 18:20:34.346 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:34.347 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:20:34.490 WARN 34018 --- [ocp-async-10,179de4994001908b,89c3b28c78452dd8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:34.490 INFO 34018 --- [ocp-async-4,bf4d177f16ea9150,5eaec7b959fa5c19] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:34.623 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:34.625 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:34.669 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:34.670 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20241231 2024-12-31 18:20:34.671 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:34.671 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:20:34.957 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:34.960 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:35.003 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:35.004 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20250101 2024-12-31 18:20:35.005 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:35.006 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:20:35.292 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:35.294 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:35.336 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:35.337 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20250102 2024-12-31 18:20:35.338 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:35.339 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:20:35.609 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:35.611 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:35.654 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:35.656 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20250103 2024-12-31 18:20:35.656 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:35.657 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:20:35.935 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:35.937 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:35.978 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:35.979 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20250104 2024-12-31 18:20:35.980 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:35.981 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:20:36.296 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:36.298 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:36.337 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:36.338 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20250105 2024-12-31 18:20:36.339 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:36.340 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:20:36.434 ERROR 34018 --- [pool-15-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing SQL_PERF_DIAGNOSER org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=3221555081) Table has no partition for value ### The error may exist in com/oceanbase/ocp/perf/sql/diag/monitordb/dao/OcpPerfSqlDiagnosisTaskDao.java (best guess) ### The error may involve com.oceanbase.ocp.perf.sql.diag.monitordb.dao.OcpPerfSqlDiagnosisTaskDao.save-Inline ### The error occurred while setting parameters ### SQL: REPLACE INTO ocp_perf_sql_diagnosis_task (task_name, begin_interval_time, end_interval_time, executor, status) VALUES (?, ?, ?, ?, ?) ### Cause: java.sql.SQLTransientConnectionException: (conn=3221555081) Table has no partition for value ; (conn=3221555081) Table has no partition for value; nested exception is java.sql.SQLTransientConnectionException: (conn=3221555081) Table has no partition for value at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:73) at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:82) at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) at com.sun.proxy.$Proxy324.insert(Unknown Source) at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62) at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) at com.sun.proxy.$Proxy520.save(Unknown Source) at com.oceanbase.ocp.perf.sql.diag.internal.access.OcpPerfSqlDiagnosisTaskDbAccessImpl.save(OcpPerfSqlDiagnosisTaskDbAccessImpl.java:25) at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService.getNextExecution(OcpPerfSqlDiagnosisTaskService.java:48) at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$FastClassBySpringCGLIB$$a1a13d9d.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707) at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$3e2e736a.getNextExecution() at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:151) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.SQLTransientConnectionException: (conn=3221555081) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:320) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:256) at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:170) at com.zaxxer.hikari.pool.ProxyPreparedStatement.execute(ProxyPreparedStatement.java:44) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.execute(HikariProxyPreparedStatement.java) at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ... 28 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:205) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:186) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:401) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:247) ... 43 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:399) ... 44 common frames omitted 2024-12-31 18:20:36.435 ERROR 34018 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing SQL_INDEX_DIAGNOSER org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=3221555156) Table has no partition for value ### The error may exist in com/oceanbase/ocp/perf/sql/diag/monitordb/dao/OcpPerfSqlDiagnosisTaskDao.java (best guess) ### The error may involve com.oceanbase.ocp.perf.sql.diag.monitordb.dao.OcpPerfSqlDiagnosisTaskDao.save-Inline ### The error occurred while setting parameters ### SQL: REPLACE INTO ocp_perf_sql_diagnosis_task (task_name, begin_interval_time, end_interval_time, executor, status) VALUES (?, ?, ?, ?, ?) ### Cause: java.sql.SQLTransientConnectionException: (conn=3221555156) Table has no partition for value ; (conn=3221555156) Table has no partition for value; nested exception is java.sql.SQLTransientConnectionException: (conn=3221555156) Table has no partition for value at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:73) at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:82) at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) at com.sun.proxy.$Proxy324.insert(Unknown Source) at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62) at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) at com.sun.proxy.$Proxy520.save(Unknown Source) at com.oceanbase.ocp.perf.sql.diag.internal.access.OcpPerfSqlDiagnosisTaskDbAccessImpl.save(OcpPerfSqlDiagnosisTaskDbAccessImpl.java:25) at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService.getNextExecution(OcpPerfSqlDiagnosisTaskService.java:48) at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$FastClassBySpringCGLIB$$a1a13d9d.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707) at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$3e2e736a.getNextExecution() at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:151) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.SQLTransientConnectionException: (conn=3221555156) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:320) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:256) at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:170) at com.zaxxer.hikari.pool.ProxyPreparedStatement.execute(ProxyPreparedStatement.java:44) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.execute(HikariProxyPreparedStatement.java) at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ... 28 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:205) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:186) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:401) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:247) ... 43 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:399) ... 44 common frames omitted 2024-12-31 18:20:36.435 ERROR 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Error in executing PLAN_CHANGE_DETECTOR org.springframework.dao.TransientDataAccessResourceException: ### Error updating database. Cause: java.sql.SQLTransientConnectionException: (conn=3221555159) Table has no partition for value ### The error may exist in com/oceanbase/ocp/perf/sql/diag/monitordb/dao/OcpPerfSqlDiagnosisTaskDao.java (best guess) ### The error may involve com.oceanbase.ocp.perf.sql.diag.monitordb.dao.OcpPerfSqlDiagnosisTaskDao.save-Inline ### The error occurred while setting parameters ### SQL: REPLACE INTO ocp_perf_sql_diagnosis_task (task_name, begin_interval_time, end_interval_time, executor, status) VALUES (?, ?, ?, ?, ?) ### Cause: java.sql.SQLTransientConnectionException: (conn=3221555159) Table has no partition for value ; (conn=3221555159) Table has no partition for value; nested exception is java.sql.SQLTransientConnectionException: (conn=3221555159) Table has no partition for value at org.springframework.jdbc.support.SQLExceptionSubclassTranslator.doTranslate(SQLExceptionSubclassTranslator.java:70) at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:73) at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:82) at org.mybatis.spring.MyBatisExceptionTranslator.translateExceptionIfPossible(MyBatisExceptionTranslator.java:88) at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:440) at com.sun.proxy.$Proxy324.insert(Unknown Source) at org.mybatis.spring.SqlSessionTemplate.insert(SqlSessionTemplate.java:271) at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:62) at org.apache.ibatis.binding.MapperProxy$PlainMethodInvoker.invoke(MapperProxy.java:152) at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:85) at com.sun.proxy.$Proxy520.save(Unknown Source) at com.oceanbase.ocp.perf.sql.diag.internal.access.OcpPerfSqlDiagnosisTaskDbAccessImpl.save(OcpPerfSqlDiagnosisTaskDbAccessImpl.java:25) at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService.getNextExecution(OcpPerfSqlDiagnosisTaskService.java:48) at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$FastClassBySpringCGLIB$$a1a13d9d.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707) at com.oceanbase.ocp.perf.sql.diag.internal.OcpPerfSqlDiagnosisTaskService$$EnhancerBySpringCGLIB$$3e2e736a.getNextExecution() at com.oceanbase.ocp.perf.sql.diag.internal.AbstractDiagnoseService.lambda$init$1(AbstractDiagnoseService.java:151) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.SQLTransientConnectionException: (conn=3221555159) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:320) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:256) at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:170) at com.zaxxer.hikari.pool.ProxyPreparedStatement.execute(ProxyPreparedStatement.java:44) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.execute(HikariProxyPreparedStatement.java) at org.apache.ibatis.executor.statement.PreparedStatementHandler.update(PreparedStatementHandler.java:47) at org.apache.ibatis.executor.statement.RoutingStatementHandler.update(RoutingStatementHandler.java:74) at org.apache.ibatis.executor.SimpleExecutor.doUpdate(SimpleExecutor.java:50) at org.apache.ibatis.executor.BaseExecutor.update(BaseExecutor.java:117) at org.apache.ibatis.executor.CachingExecutor.update(CachingExecutor.java:76) at org.apache.ibatis.session.defaults.DefaultSqlSession.update(DefaultSqlSession.java:197) at org.apache.ibatis.session.defaults.DefaultSqlSession.insert(DefaultSqlSession.java:184) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426) ... 28 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:205) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:186) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:401) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:247) ... 43 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:399) ... 44 common frames omitted 2024-12-31 18:20:36.490 WARN 34018 --- [ocp-async-2,daf9c8ac49f6a041,b180714952752ad3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:36.491 INFO 34018 --- [ocp-async-1,8e16f38f3c9e2751,0baff414e45baa8b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:36.568 INFO 34018 --- [prometheus-minute-schedule-1,c204954a5da042c4,7d617557ada92444] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:36.570 INFO 34018 --- [prometheus-cache-monitor1,444e1eeb658428f6,3857085c727d578b] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2024-12-31 18:20:36.570 INFO 34018 --- [prometheus-cache-monitor1,444e1eeb658428f6,3857085c727d578b] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{} 2024-12-31 18:20:36.591 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:36.593 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:36.635 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:36.637 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20250106 2024-12-31 18:20:36.637 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:36.638 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:20:36.760 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,881e224a6a6739af,298999d209495f25] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/stats/topAvgCompactionDuration?limit=5&inDays=7, client=10.108.139.108, traceId=881e224a6a6739af, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObClusterStatsController.getClustersTopAvgCompactionDuration(Integer,Integer), args=7,5,] 2024-12-31 18:20:36.761 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,c697c3e063d72c74,5275c9ba3f75d7aa] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/tenants/topAvgCompactionDuration?limit=5&inDays=7, client=10.108.139.108, traceId=c697c3e063d72c74, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObTenantCompactionController.topAvgCompactionDuration(Integer,Integer), args=7,5,] 2024-12-31 18:20:36.770 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,881e224a6a6739af,298999d209495f25] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/stats/topAvgCompactionDuration client=10.108.139.108, traceId=881e224a6a6739af, duration=21 ms] 2024-12-31 18:20:36.778 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,c697c3e063d72c74,5275c9ba3f75d7aa] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/tenants/topAvgCompactionDuration client=10.108.139.108, traceId=c697c3e063d72c74, duration=29 ms] 2024-12-31 18:20:36.815 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,164c70f74fcee090,b4937919f8c39fe9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/metricGroups?scope=OVERVIEW_TENANT&type=TOP, client=10.108.139.108, traceId=164c70f74fcee090, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.MonitorController.listMetricClasses(Pageable,MetricType,MetricScope,Long), args=Page request [number: 0, size 5000, sort: id: ASC],TOP,OVERVIEW_TENANT,] 2024-12-31 18:20:36.818 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,70c58603d3130ae3,342726a02d892a53] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/metricGroups?scope=OVERVIEW_ODP&type=TOP, client=10.108.139.108, traceId=70c58603d3130ae3, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.MonitorController.listMetricClasses(Pageable,MetricType,MetricScope,Long), args=Page request [number: 0, size 5000, sort: id: ASC],TOP,OVERVIEW_ODP,] 2024-12-31 18:20:36.838 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:36.840 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:36.854 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,8dc08a8fcf1429de,7e38bf79ade0a1be] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=8dc08a8fcf1429de, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:20:36.854 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,2b4cc1416a038df9,36684b8900fbe8b7] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=2b4cc1416a038df9, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:20:36.854 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,12eaf200463942b1,4f9950b0590de036] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=12eaf200463942b1, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:20:36.854 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,a1eaf4bc0aa32515,cceaaff6e13e907e] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=a1eaf4bc0aa32515, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:20:36.912 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:36.914 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:36.925 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,70c58603d3130ae3,342726a02d892a53] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/metricGroups client=10.108.139.108, traceId=70c58603d3130ae3, duration=124 ms] 2024-12-31 18:20:36.934 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,164c70f74fcee090,b4937919f8c39fe9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/metricGroups client=10.108.139.108, traceId=164c70f74fcee090, duration=137 ms] 2024-12-31 18:20:36.945 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,8dc08a8fcf1429de,7e38bf79ade0a1be] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=8dc08a8fcf1429de, duration=160 ms] 2024-12-31 18:20:36.945 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,2b4cc1416a038df9,36684b8900fbe8b7] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=2b4cc1416a038df9, duration=150 ms] 2024-12-31 18:20:36.951 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,12eaf200463942b1,4f9950b0590de036] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=12eaf200463942b1, duration=156 ms] 2024-12-31 18:20:36.956 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:36.957 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20250107 2024-12-31 18:20:36.957 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:36.958 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:20:36.964 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,a1eaf4bc0aa32515,cceaaff6e13e907e] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=a1eaf4bc0aa32515, duration=173 ms] 2024-12-31 18:20:37.061 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,7f406e90592b72b4,2690d54c3d63d683] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/metricGroups?scope=OVERVIEW_HOST&type=TOP, client=10.108.139.108, traceId=7f406e90592b72b4, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.MonitorController.listMetricClasses(Pageable,MetricType,MetricScope,Long), args=Page request [number: 0, size 5000, sort: id: ASC],TOP,OVERVIEW_HOST,] 2024-12-31 18:20:37.062 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,01daa85801086f73,353bb0d8aa8e4b5d] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/cluster/resources?metrics=ob_cpu_assigned_percentage&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id, client=10.108.139.108, traceId=01daa85801086f73, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewClusterResources(String,String,String,Integer), args=ob_cpu_assigned_percentage,app,ob_cluster_name,ob_cluster_id,app:OB,5,] 2024-12-31 18:20:37.062 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,2236143e01ad4052,e831762c2c5d145e] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/cluster/resources?metrics=ob_memory_assigned_percentage&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id, client=10.108.139.108, traceId=2236143e01ad4052, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewClusterResources(String,String,String,Integer), args=ob_memory_assigned_percentage,app,ob_cluster_name,ob_cluster_id,app:OB,5,] 2024-12-31 18:20:37.062 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,38073dc00ec2d7bc,27ca96d7c0a97625] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/cluster/resources?metrics=ob_disk_used_percentage&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id, client=10.108.139.108, traceId=38073dc00ec2d7bc, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewClusterResources(String,String,String,Integer), args=ob_disk_used_percentage,app,ob_cluster_name,ob_cluster_id,app:OB,5,] 2024-12-31 18:20:37.070 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,dd0fa72ad0fc7d5a,c2827780b1900379] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/tenant/resources?metrics=ob_memory_percent&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id%2Ctenant_name, client=10.108.139.108, traceId=dd0fa72ad0fc7d5a, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewTenantResources(String,String,String,Integer), args=ob_memory_percent,app,ob_cluster_name,ob_cluster_id,tenant_name,app:OB,5,] 2024-12-31 18:20:37.070 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,26383d431a2a2089,0b7d8532167a0327] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/tenant/resources?metrics=ob_cpu_percent&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id%2Ctenant_name, client=10.108.139.108, traceId=26383d431a2a2089, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewTenantResources(String,String,String,Integer), args=ob_cpu_percent,app,ob_cluster_name,ob_cluster_id,tenant_name,app:OB,5,] 2024-12-31 18:20:37.078 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,7f406e90592b72b4,2690d54c3d63d683] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/metricGroups client=10.108.139.108, traceId=7f406e90592b72b4, duration=26 ms] 2024-12-31 18:20:37.114 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,01daa85801086f73,353bb0d8aa8e4b5d] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/cluster/resources client=10.108.139.108, traceId=01daa85801086f73, duration=62 ms] 2024-12-31 18:20:37.114 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,2236143e01ad4052,e831762c2c5d145e] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/cluster/resources client=10.108.139.108, traceId=2236143e01ad4052, duration=61 ms] 2024-12-31 18:20:37.114 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,26383d431a2a2089,0b7d8532167a0327] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/tenant/resources client=10.108.139.108, traceId=26383d431a2a2089, duration=59 ms] 2024-12-31 18:20:37.114 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,dd0fa72ad0fc7d5a,c2827780b1900379] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/tenant/resources client=10.108.139.108, traceId=dd0fa72ad0fc7d5a, duration=60 ms] 2024-12-31 18:20:37.114 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,38073dc00ec2d7bc,27ca96d7c0a97625] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/cluster/resources client=10.108.139.108, traceId=38073dc00ec2d7bc, duration=61 ms] 2024-12-31 18:20:37.210 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:37.211 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:37.247 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:37.248 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_stat, partition=P20250108 2024-12-31 18:20:37.249 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:37.249 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_stat` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:20:37.360 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,aed3924257996c2e,31c525cf1aec3aed] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/tenant/resources?metrics=ob_tenant_disk_usage_v4&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id%2Ctenant_name, client=10.108.139.108, traceId=aed3924257996c2e, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewTenantResources(String,String,String,Integer), args=ob_tenant_disk_usage_v4,app,ob_cluster_name,ob_cluster_id,tenant_name,app:OB,5,] 2024-12-31 18:20:37.363 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,3884bdafe7f73695,e3cd0c497c837b0a] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?foldStandby=false, client=10.108.139.108, traceId=3884bdafe7f73695, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObClusterController.listObClusters(String,List,boolean,Boolean,WithRemote,List,Pageable), args=false,NONE,Page request [number: 0, size 5000, sort: name: ASC,obClusterId: ASC],] 2024-12-31 18:20:37.367 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,aed3924257996c2e,31c525cf1aec3aed] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/tenant/resources client=10.108.139.108, traceId=aed3924257996c2e, duration=14 ms] 2024-12-31 18:20:37.447 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,3884bdafe7f73695,e3cd0c497c837b0a] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=10.108.139.108, traceId=3884bdafe7f73695, duration=94 ms] 2024-12-31 18:20:37.507 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:37.508 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_stat' and table_type='BASE TABLE' 2024-12-31 18:20:37.544 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_stat 2024-12-31 18:20:37.546 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:37.546 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:20:37.547 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:37.547 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sqltext 2024-12-31 18:20:37.579 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241216 2024-12-31 18:20:37.579 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:37.580 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241216 values less than (1734393600000000)) 2024-12-31 18:20:37.970 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:37.971 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:38.007 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:38.008 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241217 2024-12-31 18:20:38.008 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:38.009 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241217 values less than (1734480000000000)) 2024-12-31 18:20:38.483 INFO 34018 --- [ocp-async-1,f3e2393fcd4637c5,d47e7d06a5eee5d8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:20:38.491 WARN 34018 --- [ocp-async-7,ee1a48e78fe9d337,a9911e9ee0c48f7d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:38.491 INFO 34018 --- [ocp-async-5,0db1a8c812a9ac18,8598cb09c43330e4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:38.497 INFO 34018 --- [ocp-schedules-23,aa09d53b8f409098,760d00585268fe63] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:20:38.559 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:38.561 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:38.605 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:38.607 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241218 2024-12-31 18:20:38.607 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:38.608 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241218 values less than (1734566400000000)) 2024-12-31 18:20:39.122 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:39.123 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:39.165 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:39.166 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241219 2024-12-31 18:20:39.167 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:39.168 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241219 values less than (1734652800000000)) 2024-12-31 18:20:39.568 INFO 34018 --- [prometheus-minute-schedule-1,91f8783cca31e37c,137c0ee1a8ed29e0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:39.704 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:39.705 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:39.746 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:39.747 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241220 2024-12-31 18:20:39.748 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:39.749 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241220 values less than (1734739200000000)) 2024-12-31 18:20:39.840 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:39.842 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:40.004 INFO 34018 --- [ocp-schedules-9,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:20:40.004 INFO 34018 --- [ocp-schedules-1,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:20:40.330 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:40.331 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:40.374 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:40.375 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241221 2024-12-31 18:20:40.375 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:40.376 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241221 values less than (1734825600000000)) 2024-12-31 18:20:40.491 WARN 34018 --- [ocp-async-3,72c08ae575389298,84e00ad4bb930a81] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:40.491 INFO 34018 --- [ocp-async-5,92931bad7024d95c,f48976a3511c4b3c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:40.856 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:40.858 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:40.899 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:40.900 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241222 2024-12-31 18:20:40.901 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:40.902 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241222 values less than (1734912000000000)) 2024-12-31 18:20:41.394 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:41.395 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:41.437 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:41.438 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241223 2024-12-31 18:20:41.439 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:41.440 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241223 values less than (1734998400000000)) 2024-12-31 18:20:41.949 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:41.951 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:41.997 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:41.999 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241224 2024-12-31 18:20:42.000 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:42.000 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241224 values less than (1735084800000000)) 2024-12-31 18:20:42.491 WARN 34018 --- [ocp-async-5,6bb088832469ef31,711f32b83f1174d4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:42.492 INFO 34018 --- [ocp-async-6,acacf2257ef940c1,5df32b7489ec761a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:42.535 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:42.536 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:42.568 INFO 34018 --- [prometheus-minute-schedule-1,42baf5d169f972e1,de92955f8f432a8b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:42.577 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:42.578 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241225 2024-12-31 18:20:42.579 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:42.580 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241225 values less than (1735171200000000)) 2024-12-31 18:20:42.843 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:42.846 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:43.123 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:43.128 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:43.171 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:43.172 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241226 2024-12-31 18:20:43.173 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:43.173 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:20:43.678 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:43.679 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:43.721 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:43.722 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241227 2024-12-31 18:20:43.723 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:43.724 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:20:44.235 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:44.237 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:44.281 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:44.282 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241228 2024-12-31 18:20:44.283 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:44.284 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:20:44.491 WARN 34018 --- [ocp-async-9,8990437499d89279,a76e3a3d22f5d753] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:44.492 INFO 34018 --- [ocp-async-10,3b57e1d54e73069b,f783ebe4952b3e8d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:44.789 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:44.791 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:44.830 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:44.831 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241229 2024-12-31 18:20:44.832 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:44.833 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:20:45.423 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:45.425 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:45.469 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:45.470 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241230 2024-12-31 18:20:45.471 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:45.472 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:20:45.568 INFO 34018 --- [prometheus-minute-schedule-1,30586edaef079f19,bb719b00fc7e198b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:45.846 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:45.848 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:45.957 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:45.959 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:45.996 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:45.997 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20241231 2024-12-31 18:20:45.998 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:45.999 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:20:46.492 WARN 34018 --- [ocp-async-4,b2c040c6b821c4cd,4cf5d241c881aef7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:46.492 INFO 34018 --- [ocp-async-3,28cf02e4a8449396,ff0f4329fce3aef5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:46.495 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:46.497 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:46.541 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:46.542 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20250101 2024-12-31 18:20:46.543 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:46.543 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:20:47.097 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:47.098 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:47.142 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:47.143 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20250102 2024-12-31 18:20:47.144 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:47.145 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:20:47.651 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:47.653 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:47.702 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:47.703 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20250103 2024-12-31 18:20:47.704 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:47.704 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:20:48.256 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:48.258 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:48.304 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:48.305 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20250104 2024-12-31 18:20:48.306 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:48.306 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:20:48.456 INFO 34018 --- [ocp-schedules-15,c796b56dff13bb0a,27a1472b091a03fb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:20:48.458 INFO 34018 --- [ocp-schedules-11,8844a0d393609a24,3e288d5cba625063] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:20:48.458 INFO 34018 --- [ocp-schedules-3,594268a9707aa8fd,e2c096f047e93b50] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:20:48.458 INFO 34018 --- [ocp-schedules-18,ddcfa3a8d4c74250,08f13598229c4d5f] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:20:48.459 INFO 34018 --- [ocp-schedules-30,10a5f59417b85a44,ccef4586678133ee] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:20:48.459 INFO 34018 --- [ocp-schedules-6,8df73c519429fa7a,99e618c5c82e26d0] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:20:48.464 INFO 34018 --- [ocp-schedules-15,c796b56dff13bb0a,27a1472b091a03fb] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:20:48.465 INFO 34018 --- [ocp-schedules-1,a240ab1791c8c361,d35e0e8635f09cbd] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:20:48.469 INFO 34018 --- [ocp-schedules-6,8df73c519429fa7a,99e618c5c82e26d0] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:20:48.483 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.ocp.alarm.core.task.AlarmDetectTask : refresh host alarm wrapper 2024-12-31 18:20:48.484 INFO 34018 --- [ocp-async-7,ce758cffcdca8461,8cc56e03d281949c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:20:48.495 WARN 34018 --- [ocp-async-6,893766b948ce3fc0,bfb3c6caebe18de4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:48.496 INFO 34018 --- [ocp-async-9,9ae920942013879b,f81a7ec4135be629] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:48.506 INFO 34018 --- [ocp-schedules-30,2bc8a59a759ea21c,59abd0a283a9de0f] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:20:48.508 INFO 34018 --- [ocp-schedules-16,9c009058ae2aac62,a056809faf1ba8ad] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:20:48.508 INFO 34018 --- [ocp-schedules-6,acd821469538879f,5896dbecda156f18] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:20:48.509 INFO 34018 --- [ocp-schedules-29,584d8c8a882f01ca,6fe32fe917d9b136] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2024-12-31 18:20:48.509 INFO 34018 --- [ocp-schedules-23,d7e99fa6626d8a04,330ed94d767f5096] c.o.o.a.service.OcpAlarmInspectService : delete inactive alarm event count 0 2024-12-31 18:20:48.509 INFO 34018 --- [ocp-schedules-23,d7e99fa6626d8a04,330ed94d767f5096] c.o.o.a.service.OcpAlarmInspectService : deleteInactiveAlarmEvents count 0 2024-12-31 18:20:48.511 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.ocp.alarm.core.task.AlarmDetectTask : refresh alarm target 2024-12-31 18:20:48.523 INFO 34018 --- [ocp-schedules-5,35901c5971627b3a,c907691e30303440] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:20:48.523+08:00, clusters=[] 2024-12-31 18:20:48.526 INFO 34018 --- [ocp-schedules-2,2da1a7cf2d06db97,80761bbf33cb393c] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:20:48.526 INFO 34018 --- [ocp-schedules-2,2da1a7cf2d06db97,80761bbf33cb393c] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:20:48.526 INFO 34018 --- [ocp-schedules-9,718f5d43eaabeed5,46c68f143f1a0ff8] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:20:48.527 INFO 34018 --- [ocp-schedules-25,1f454c810f8eacd0,862d6b7502e1b292] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:20:48.527 INFO 34018 --- [ocp-schedules-1,c5fb20ab5ec6faca,5bc501f38f08f189] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:20:48.527+08:00, clusters=[] 2024-12-31 18:20:48.528 INFO 34018 --- [ocp-schedules-8,d936692971756b4e,334441ad60cd39a6] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:20:48.528 INFO 34018 --- [ocp-schedules-8,d936692971756b4e,334441ad60cd39a6] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:20:48.528 INFO 34018 --- [ocp-schedules-10,da7b9d19fa7301e0,0450d2d2a22c74d8] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:20:48.529 INFO 34018 --- [ocp-schedules-2,2da1a7cf2d06db97,80761bbf33cb393c] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:20:48.529 INFO 34018 --- [ocp-schedules-2,2da1a7cf2d06db97,80761bbf33cb393c] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:20:48.531 INFO 34018 --- [ocp-schedules-28,0ec4a9348bd356d3,87a7a6fdf613f44f] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:20:48.531 INFO 34018 --- [ocp-schedules-3,3f22d765ce348be5,0ff0642679694908] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:20:48.553 INFO 34018 --- [ocp-schedules-3,3f22d765ce348be5,0ff0642679694908] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:20:48.553 INFO 34018 --- [ocp-schedules-3,3f22d765ce348be5,0ff0642679694908] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 0 2024-12-31 18:20:48.562 INFO 34018 --- [ocp-schedules-28,03dc85adeef0d70e,711f8bada1369197] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:20:48.563 INFO 34018 --- [ocp-schedules-28,03dc85adeef0d70e,711f8bada1369197] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:20:48.563 INFO 34018 --- [ocp-schedules-10,da7b9d19fa7301e0,0450d2d2a22c74d8] c.o.o.a.service.TaskRepositoryService : fetchNeedExecute, tryAcquireTasksCount=1, fetchedCount=1 2024-12-31 18:20:48.568 INFO 34018 --- [prometheus-minute-schedule-1,c57ce159bdf63755,8198170510cf4660] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:48.570 INFO 34018 --- [ocp-schedules-28,03dc85adeef0d70e,711f8bada1369197] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:20:48.570 INFO 34018 --- [ocp-schedules-28,03dc85adeef0d70e,711f8bada1369197] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:20:48.575 INFO 34018 --- [ocp-schedules-28,03dc85adeef0d70e,711f8bada1369197] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:20:48.575 INFO 34018 --- [ocp-schedules-28,03dc85adeef0d70e,711f8bada1369197] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:20:48.588 INFO 34018 --- [ocp-schedules-10,da7b9d19fa7301e0,0450d2d2a22c74d8] c.o.o.alarm.core.process.AlarmProcessor : AlarmProcessor init done, lastProcessTime=2024-12-31T18:20:48.584209+08:00 2024-12-31 18:20:48.589 INFO 34018 --- [ocp-schedules-10,da7b9d19fa7301e0,0450d2d2a22c74d8] c.o.o.alarm.core.task.AlarmProcessTask : AlarmProcessTask created 2024-12-31 18:20:48.589 INFO 34018 --- [ocp-schedules-10,da7b9d19fa7301e0,0450d2d2a22c74d8] c.o.o.alarm.utils.task.AlarmTaskManager : start task, taskInfo=TaskInfo(id=1, uuid=05b0ee56-3bf6-4d1d-a3be-d1fe245934fa, taskType=AlarmProcess, target=null, parameters=null, intervalSeconds=10, status=EXECUTING, executorName=10.79.169.37:34018, createAt=2024-12-31T10:15:13.165800Z, startAt=2024-12-31T10:20:48.529Z, endAt=null, heartbeatAt=2024-12-31T10:20:48.529Z, result=executing) 2024-12-31 18:20:48.589 INFO 34018 --- [ocp-schedules-10,da7b9d19fa7301e0,0450d2d2a22c74d8] c.o.o.alarm.utils.task.AlarmTaskManager : startNeedExecute, activeCount=0, tryStartCount=1, startedCount=1 2024-12-31 18:20:48.600 INFO 34018 --- [ocp-schedules-29,584d8c8a882f01ca,6fe32fe917d9b136] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2024-12-31 18:20:48.708 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_merge_timeout, expression merge_timeout_flag == 1 2024-12-31 18:20:48.721 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_merge_timeout_flag', labels={}}], alarmTargets 2024-12-31 18:20:48.723 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_timeout 2024-12-31 18:20:48.723 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_merge_timeout 2024-12-31 18:20:48.724 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_traffic_drop, expression net_receive_drop_count > 100 2024-12-31 18:20:48.724 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_net_receive_drop_count', labels={}}], alarmTargets 2024-12-31 18:20:48.724 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_drop 2024-12-31 18:20:48.724 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_traffic_drop 2024-12-31 18:20:48.725 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_cannot_connect_arbitration, expression arbitration_status_inactive_server_count > 0 2024-12-31 18:20:48.725 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='arbitration_status_inactive_server_count', labels={}}], alarmTargets 2024-12-31 18:20:48.725 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_cannot_connect_arbitration 2024-12-31 18:20:48.725 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_server_cannot_connect_arbitration 2024-12-31 18:20:48.728 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_partition_leader_absent, expression tenant_partition_leader_absent_count > 100 2024-12-31 18:20:48.729 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_partition_leader_absent_count', labels={}}], alarmTargets 2024-12-31 18:20:48.729 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_partition_leader_absent 2024-12-31 18:20:48.729 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_partition_leader_absent 2024-12-31 18:20:48.729 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cpu_percent_over_threshold, expression ob_tenant_thread_percent > 80 2024-12-31 18:20:48.729 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cpu_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.729 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cpu_percent_over_threshold 2024-12-31 18:20:48.729 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cpu_percent_over_threshold 2024-12-31 18:20:48.730 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_alarm_detect_timeout, expression ocp_alarm_detect_duration_seconds >= 3 2024-12-31 18:20:48.731 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_alarm_detect_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.731 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_alarm_detect_timeout 2024-12-31 18:20:48.731 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_alarm_detect_timeout 2024-12-31 18:20:48.731 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for backup_storage_capacity_retry_times_exceeded, expression storage_capacity_monitor_error_code == 1001 2024-12-31 18:20:48.731 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='storage_capacity_monitor_error_code', labels={}}], alarmTargets 2024-12-31 18:20:48.731 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_retry_times_exceeded 2024-12-31 18:20:48.731 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-backup_storage_capacity_retry_times_exceeded 2024-12-31 18:20:48.759 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_log_disk_percent_over_threshold, expression ob_log_disk_usage_percent > 95 2024-12-31 18:20:48.759 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_log_disk_percent_over_threshold, expression ob_log_disk_usage_percent > 92 2024-12-31 18:20:48.759 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_log_path_disk_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.760 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_log_disk_percent_over_threshold 2024-12-31 18:20:48.760 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_log_disk_percent_over_threshold 2024-12-31 18:20:48.760 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_cpu_util_hwm, expression cpu_used_percent > 90 and cpu_steal < 20 2024-12-31 18:20:48.761 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_cpu_steal', labels={}}, Metric{name='host_cpu_used_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.761 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_hwm 2024-12-31 18:20:48.761 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_cpu_util_hwm 2024-12-31 18:20:48.761 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_nic_1000m_hwm, expression eth_net_traffic_usage > 80 and eth_net_bandwidth_mbps < 300 and eth_net_bandwidth_mbps > 0 2024-12-31 18:20:48.761 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='host_eth_net_traffic_usage', labels={}}], alarmTargets 2024-12-31 18:20:48.761 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_hwm 2024-12-31 18:20:48.761 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_nic_1000m_hwm 2024-12-31 18:20:48.762 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_cannot_connected, expression obproxy_connectable == 0 2024-12-31 18:20:48.762 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_connectable', labels={}}], alarmTargets 2024-12-31 18:20:48.762 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_cannot_connected 2024-12-31 18:20:48.762 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_cannot_connected 2024-12-31 18:20:48.762 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_recyclebin_disk_used_over_threshold, expression ob_database_disk_used_gb > 100 2024-12-31 18:20:48.762 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_recyclebin_disk_used_gb', labels={}}], alarmTargets 2024-12-31 18:20:48.762 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_recyclebin_disk_used_over_threshold 2024-12-31 18:20:48.762 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_recyclebin_disk_used_over_threshold 2024-12-31 18:20:48.762 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_cannot_connect_to_leader, expression etcd_leader_connectable == 0 2024-12-31 18:20:48.762 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_leader_connectable', labels={}}], alarmTargets 2024-12-31 18:20:48.763 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_cannot_connect_to_leader 2024-12-31 18:20:48.763 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_cannot_connect_to_leader 2024-12-31 18:20:48.763 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_net_send_percent_over_threshold, expression net_send_percent > 80 and eth_net_bandwidth_mbps > 0 2024-12-31 18:20:48.763 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='ob_host_net_send_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.763 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_send_percent_over_threshold 2024-12-31 18:20:48.763 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_net_send_percent_over_threshold 2024-12-31 18:20:48.765 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_sda_ioawait, expression io_await >= 200 and io_util >= 99 2024-12-31 18:20:48.765 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_io_await', labels={}}, Metric{name='ob_host_io_util', labels={}}], alarmTargets 2024-12-31 18:20:48.765 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_sda_ioawait 2024-12-31 18:20:48.765 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_sda_ioawait 2024-12-31 18:20:48.767 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for refresh_location_cache_failed_by_metric, expression location_cache_log_count > 0 and location_cache_success_count == 0 and location_cache_sql_success_count == 0 2024-12-31 18:20:48.767 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_location_cache_log_count', labels={}}, Metric{name='ob_cluster_location_cache_success_count', labels={}}, Metric{name='ob_cluster_location_cache_sql_success_count', labels={}}], alarmTargets 2024-12-31 18:20:48.767 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=refresh_location_cache_failed_by_metric 2024-12-31 18:20:48.767 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-refresh_location_cache_failed_by_metric 2024-12-31 18:20:48.768 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_nvme_ioawait, expression io_await > 20 and io_util >= 98 and io_qusize >= 20 2024-12-31 18:20:48.768 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_io_qusize', labels={}}, Metric{name='ob_host_io_await', labels={}}, Metric{name='ob_host_io_util', labels={}}], alarmTargets 2024-12-31 18:20:48.768 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_nvme_ioawait 2024-12-31 18:20:48.768 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_nvme_ioawait 2024-12-31 18:20:48.768 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ic_server_connect_failed, expression ic_server_health == 0 2024-12-31 18:20:48.768 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ic_server_health', labels={}}], alarmTargets 2024-12-31 18:20:48.768 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ic_server_connect_failed 2024-12-31 18:20:48.768 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ic_server_connect_failed 2024-12-31 18:20:48.768 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_sync_failed, expression ob_cluster_sync == 0 2024-12-31 18:20:48.769 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_sync', labels={}}], alarmTargets 2024-12-31 18:20:48.769 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_failed 2024-12-31 18:20:48.769 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_sync_failed 2024-12-31 18:20:48.769 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_process_dead, expression oblb_process_exists == 0 or oblb_service_connectable == 0 2024-12-31 18:20:48.769 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_process_exists', labels={}}, Metric{name='oblb_service_connectable', labels={}}], alarmTargets 2024-12-31 18:20:48.769 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_process_dead 2024-12-31 18:20:48.769 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_process_dead 2024-12-31 18:20:48.769 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_traffic_error, expression net_traffic_err_count > 100 2024-12-31 18:20:48.769 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_net_traffic_err_count', labels={}}], alarmTargets 2024-12-31 18:20:48.769 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_error 2024-12-31 18:20:48.769 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_traffic_error 2024-12-31 18:20:48.769 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_memstore_percent_over_threshold, expression memstore_percent > 95 2024-12-31 18:20:48.770 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_memstore_percent_over_threshold, expression memstore_percent > 85 2024-12-31 18:20:48.770 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_memstore_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.770 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_memstore_percent_over_threshold 2024-12-31 18:20:48.770 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-tenant_memstore_percent_over_threshold 2024-12-31 18:20:48.770 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_node_status_abnormal, expression binlog_node_available == 0 2024-12-31 18:20:48.770 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_node_available', labels={}}], alarmTargets 2024-12-31 18:20:48.770 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_node_status_abnormal 2024-12-31 18:20:48.770 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_node_status_abnormal 2024-12-31 18:20:48.770 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_nic_usage_over_threshold, expression oblb_net_traffic_usage > 80 and net_bandwidth_mbps > 0 2024-12-31 18:20:48.770 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_net_traffic_usage', labels={}}, Metric{name='net_bandwidth_mbps', labels={}}], alarmTargets 2024-12-31 18:20:48.770 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_nic_usage_over_threshold 2024-12-31 18:20:48.770 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_nic_usage_over_threshold 2024-12-31 18:20:48.771 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_ip_forward_invalid, expression oblb_ip_forward_status != 1 2024-12-31 18:20:48.771 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_ip_forward_status', labels={}}], alarmTargets 2024-12-31 18:20:48.771 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_ip_forward_invalid 2024-12-31 18:20:48.771 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_ip_forward_invalid 2024-12-31 18:20:48.771 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for arbitration_service_unavailable, expression arbitration_service_available == 0 2024-12-31 18:20:48.771 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='arbitration_service_available', labels={}}], alarmTargets 2024-12-31 18:20:48.772 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=arbitration_service_unavailable 2024-12-31 18:20:48.772 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-arbitration_service_unavailable 2024-12-31 18:20:48.772 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_active_memstore_percent_over_threshold, expression active_memstore_percent > 110 2024-12-31 18:20:48.772 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_active_memstore_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.772 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_active_memstore_percent_over_threshold 2024-12-31 18:20:48.772 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-tenant_active_memstore_percent_over_threshold 2024-12-31 18:20:48.772 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_service_conversion_delay, expression binlog_conversion_delay > 10000 2024-12-31 18:20:48.772 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_conversion_delay', labels={}}], alarmTargets 2024-12-31 18:20:48.772 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_service_conversion_delay 2024-12-31 18:20:48.772 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_service_conversion_delay 2024-12-31 18:20:48.772 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obagent_dead, expression host_agent_process_status == 0 2024-12-31 18:20:48.772 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_process_status', labels={}}], alarmTargets 2024-12-31 18:20:48.773 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obagent_dead 2024-12-31 18:20:48.773 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obagent_dead 2024-12-31 18:20:48.773 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_host_memory_usage_over_threshold, expression binlog_host_memory_usage > 90 2024-12-31 18:20:48.773 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_host_memory_usage', labels={}}], alarmTargets 2024-12-31 18:20:48.773 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_host_memory_usage_over_threshold 2024-12-31 18:20:48.773 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_host_memory_usage_over_threshold 2024-12-31 18:20:48.773 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for monagent_process_stop, expression monagent_boot_time_delta_seconds > 0 2024-12-31 18:20:48.773 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='monagent_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.773 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=monagent_process_stop 2024-12-31 18:20:48.773 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-monagent_process_stop 2024-12-31 18:20:48.774 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for mgragent_process_stop, expression mgragent_boot_time_delta_seconds > 0 2024-12-31 18:20:48.774 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='mgragent_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.774 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=mgragent_process_stop 2024-12-31 18:20:48.774 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-mgragent_process_stop 2024-12-31 18:20:48.774 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_nic_1000m_full, expression eth_net_traffic_usage > 92 and eth_net_bandwidth_mbps < 300 and eth_net_bandwidth_mbps > 0 2024-12-31 18:20:48.774 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='host_eth_net_traffic_usage', labels={}}], alarmTargets 2024-12-31 18:20:48.774 INFO 34018 --- [ocp-schedules-10,da7b9d19fa7301e0,0450d2d2a22c74d8] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:20:48.774 INFO 34018 --- [ocp-schedules-10,da7b9d19fa7301e0,0450d2d2a22c74d8] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:20:48.774 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_full 2024-12-31 18:20:48.774 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_nic_1000m_full 2024-12-31 18:20:48.774 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_monitordb_disconnected, expression monitordb_connectable == 0 2024-12-31 18:20:48.775 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='monitordb_connectable', labels={}}], alarmTargets 2024-12-31 18:20:48.775 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_monitordb_disconnected 2024-12-31 18:20:48.775 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_monitordb_disconnected 2024-12-31 18:20:48.775 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxyd_process_stop, expression obproxyd_boot_time_delta_seconds > 0 2024-12-31 18:20:48.775 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxyd_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.775 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxyd_process_stop 2024-12-31 18:20:48.775 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxyd_process_stop 2024-12-31 18:20:48.775 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_host_storage_usage_over_threshold, expression binlog_host_storage_usage > 90 2024-12-31 18:20:48.775 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_host_storage_usage', labels={}}], alarmTargets 2024-12-31 18:20:48.775 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_host_storage_usage_over_threshold 2024-12-31 18:20:48.775 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_host_storage_usage_over_threshold 2024-12-31 18:20:48.776 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant500_mem_hold_percent_over_threshold, expression tenant500_mem_hold_percent > 95 2024-12-31 18:20:48.776 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant500_mem_hold_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.776 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_percent_over_threshold 2024-12-31 18:20:48.776 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant500_mem_hold_percent_over_threshold 2024-12-31 18:20:48.776 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for vpc_connect_failed, expression vpc_network_health == 0 2024-12-31 18:20:48.776 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='vpc_network_health', labels={}}], alarmTargets 2024-12-31 18:20:48.776 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=vpc_connect_failed 2024-12-31 18:20:48.776 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-vpc_connect_failed 2024-12-31 18:20:48.776 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_observer_fd_usage, expression observer_fd_usage > 65 and observer_fd_count > 0 2024-12-31 18:20:48.776 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_observer_fd_count', labels={}}, Metric{name='ob_host_observer_fd_usage', labels={}}], alarmTargets 2024-12-31 18:20:48.776 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_fd_usage 2024-12-31 18:20:48.776 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_observer_fd_usage 2024-12-31 18:20:48.777 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_sstable_percent_over_threshold, expression ob_disk_percent > 97 2024-12-31 18:20:48.777 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_sstable_percent_over_threshold, expression ob_disk_percent > 85 2024-12-31 18:20:48.777 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_server_disk_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.777 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_sstable_percent_over_threshold 2024-12-31 18:20:48.777 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_server_sstable_percent_over_threshold 2024-12-31 18:20:48.777 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_leader_absent, expression etcd_leader_count != 1 2024-12-31 18:20:48.777 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_leader_count', labels={}}], alarmTargets 2024-12-31 18:20:48.777 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_leader_absent 2024-12-31 18:20:48.777 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_leader_absent 2024-12-31 18:20:48.778 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant500_mem_hold_over_threshold, expression tenant500_mem_hold > 100 2024-12-31 18:20:48.779 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant500_mem_hold_gigabyte', labels={}}], alarmTargets 2024-12-31 18:20:48.779 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_over_threshold 2024-12-31 18:20:48.779 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant500_mem_hold_over_threshold 2024-12-31 18:20:48.779 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_exists_expired_xa_trans, expression xa_trans_max_duration_seconds > 1200 2024-12-31 18:20:48.779 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_xa_trans_max_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.779 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_exists_expired_xa_trans 2024-12-31 18:20:48.779 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_exists_expired_xa_trans 2024-12-31 18:20:48.779 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for agentd_process_stop, expression agentd_boot_time_delta_seconds > 0 2024-12-31 18:20:48.780 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='agentd_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.780 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=agentd_process_stop 2024-12-31 18:20:48.780 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-agentd_process_stop 2024-12-31 18:20:48.780 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_no_merge, expression no_merge_time > 108000 2024-12-31 18:20:48.780 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_no_merge_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.780 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_merge 2024-12-31 18:20:48.780 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_no_merge 2024-12-31 18:20:48.780 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_no_compaction, expression no_compaction_seconds > 108000 2024-12-31 18:20:48.780 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_no_compaction_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.780 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_compaction 2024-12-31 18:20:48.780 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_no_compaction 2024-12-31 18:20:48.780 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_traffic_overload, expression eth_net_traffic_usage > 80 and eth_net_bandwidth_mbps > 0 2024-12-31 18:20:48.780 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='host_eth_net_traffic_usage', labels={}}], alarmTargets 2024-12-31 18:20:48.781 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_overload 2024-12-31 18:20:48.781 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_traffic_overload 2024-12-31 18:20:48.781 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_mem_percent_over_threshold, expression memory_percent > 97 2024-12-31 18:20:48.781 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_mem_percent_over_threshold, expression memory_percent > 95 2024-12-31 18:20:48.781 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_mem_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.781 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_mem_percent_over_threshold 2024-12-31 18:20:48.781 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_mem_percent_over_threshold 2024-12-31 18:20:48.781 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_connection_percent_over_threshold, expression ob_connection_percent > 80 2024-12-31 18:20:48.781 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_connection_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.781 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_connection_percent_over_threshold 2024-12-31 18:20:48.781 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_connection_percent_over_threshold 2024-12-31 18:20:48.781 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for observer_process_stop, expression observer_boot_time_delta_seconds > 0 2024-12-31 18:20:48.782 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='observer_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.782 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=observer_process_stop 2024-12-31 18:20:48.782 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-observer_process_stop 2024-12-31 18:20:48.782 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_stopped, expression ob_server_stopped_duration_seconds > 0 2024-12-31 18:20:48.782 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_stopped_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.782 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_stopped 2024-12-31 18:20:48.782 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_server_stopped 2024-12-31 18:20:48.782 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for host_ntp_offset_too_large, expression ntp_offset_milliseconds > 100 2024-12-31 18:20:48.782 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for host_ntp_offset_too_large, expression ntp_offset_milliseconds > 50 2024-12-31 18:20:48.782 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_ntp_offset_milliseconds', labels={}}], alarmTargets 2024-12-31 18:20:48.782 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_offset_too_large 2024-12-31 18:20:48.782 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_ntp_offset_too_large 2024-12-31 18:20:48.782 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for node_file_inode_usage, expression file_inode_usage > 80 2024-12-31 18:20:48.783 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_file_inode_usage', labels={}}], alarmTargets 2024-12-31 18:20:48.783 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_inode_usage 2024-12-31 18:20:48.783 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-node_file_inode_usage 2024-12-31 18:20:48.783 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for standby_tenant_sync_delay_too_long, expression standby_tenant_delay_seconds >= 600 2024-12-31 18:20:48.783 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='standby_tenant_delay_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.783 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=standby_tenant_sync_delay_too_long 2024-12-31 18:20:48.783 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-standby_tenant_sync_delay_too_long 2024-12-31 18:20:48.783 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_expired_trans_exist, expression pending_trans_max_duration_seconds > 1200 2024-12-31 18:20:48.783 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_pending_trans_max_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.783 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_expired_trans_exist 2024-12-31 18:20:48.783 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_expired_trans_exist 2024-12-31 18:20:48.784 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_large_trans_exist, expression trans_max_log_size_mb > 102400 2024-12-31 18:20:48.784 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_trans_max_log_size_mb', labels={}}], alarmTargets 2024-12-31 18:20:48.784 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_large_trans_exist 2024-12-31 18:20:48.784 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_large_trans_exist 2024-12-31 18:20:48.784 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant500_storage_short_meta_mem_hold_high, expression tenant500_storage_short_meta_hold_percentage > 30 and tenant500_storage_short_meta_hold_gb > 0 2024-12-31 18:20:48.784 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant500_storage_short_meta_hold_gb', labels={}}, Metric{name='tenant500_storage_short_meta_hold_percentage', labels={}}], alarmTargets 2024-12-31 18:20:48.784 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_storage_short_meta_mem_hold_high 2024-12-31 18:20:48.784 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant500_storage_short_meta_mem_hold_high 2024-12-31 18:20:48.784 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_cpu_util_full, expression cpu_used_percent >= 98 2024-12-31 18:20:48.784 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_cpu_used_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.785 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_full 2024-12-31 18:20:48.785 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_cpu_util_full 2024-12-31 18:20:48.785 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_leader_switched, expression etcd_leader_switch_count > 0 2024-12-31 18:20:48.785 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_leader_switch_count', labels={}}], alarmTargets 2024-12-31 18:20:48.785 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_leader_switched 2024-12-31 18:20:48.785 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_leader_switched 2024-12-31 18:20:48.785 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for host_ntp_service_not_exist, expression ntp_service_exist == 0 or ntp_service_available == 0 2024-12-31 18:20:48.786 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_ntp_service_exist', labels={}}, Metric{name='host_ntp_service_available', labels={}}], alarmTargets 2024-12-31 18:20:48.786 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_service_not_exist 2024-12-31 18:20:48.786 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_ntp_service_not_exist 2024-12-31 18:20:48.786 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for standby_tenant_sync_status_error, expression standby_tenant_restore_status_code == 2 2024-12-31 18:20:48.786 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for standby_tenant_sync_status_error, expression standby_tenant_restore_status_code == 1 2024-12-31 18:20:48.786 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='standby_tenant_restore_status_code', labels={}}], alarmTargets 2024-12-31 18:20:48.786 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=standby_tenant_sync_status_error 2024-12-31 18:20:48.786 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-standby_tenant_sync_status_error 2024-12-31 18:20:48.786 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_task_timeout, expression ob_server_task_max_duration_seconds > 10800 2024-12-31 18:20:48.786 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_task_max_duration', labels={}}], alarmTargets 2024-12-31 18:20:48.786 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_task_timeout 2024-12-31 18:20:48.787 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_task_timeout 2024-12-31 18:20:48.787 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_cpu_sys_abnormal, expression cpu_system > 40 2024-12-31 18:20:48.787 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_cpu_system', labels={}}], alarmTargets 2024-12-31 18:20:48.787 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_sys_abnormal 2024-12-31 18:20:48.787 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_cpu_sys_abnormal 2024-12-31 18:20:48.787 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_status_check_failed, expression ob_cluster_status_check == 0 2024-12-31 18:20:48.787 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_status_check', labels={}}], alarmTargets 2024-12-31 18:20:48.787 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_status_check_failed 2024-12-31 18:20:48.787 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_status_check_failed 2024-12-31 18:20:48.788 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_invalid_disk_exists, expression ob_disk_invalid_count > 0 2024-12-31 18:20:48.788 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_server_invalid_disk_count', labels={}}], alarmTargets 2024-12-31 18:20:48.788 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_invalid_disk_exists 2024-12-31 18:20:48.788 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_invalid_disk_exists 2024-12-31 18:20:48.788 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_keepalived_master_switched, expression keepalived_release_master_count > 0 2024-12-31 18:20:48.788 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_keepalived_release_master_count', labels={}}], alarmTargets 2024-12-31 18:20:48.788 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_keepalived_master_switched 2024-12-31 18:20:48.788 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_keepalived_master_switched 2024-12-31 18:20:48.788 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_exists_inactive_server, expression oblb_inactive_server_count > 0 2024-12-31 18:20:48.789 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_inactive_server_count', labels={}}], alarmTargets 2024-12-31 18:20:48.789 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_exists_inactive_server 2024-12-31 18:20:48.789 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_exists_inactive_server 2024-12-31 18:20:48.789 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_tcp_retrans_percent_over_threshold, expression tcp_retrans_percent > 10 2024-12-31 18:20:48.789 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_tcp_retrans_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.789 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_tcp_retrans_percent_over_threshold 2024-12-31 18:20:48.789 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_tcp_retrans_percent_over_threshold 2024-12-31 18:20:48.789 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_cpu_percent_over_threshold, expression cpu_percent > 90 2024-12-31 18:20:48.789 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_cpu_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.789 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_cpu_percent_over_threshold 2024-12-31 18:20:48.789 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_cpu_percent_over_threshold 2024-12-31 18:20:48.790 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_process_dead, expression obdns_etcd_process_exists == 0 or obdns_etcd_connectable == 0 2024-12-31 18:20:48.790 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_connectable', labels={}}, Metric{name='obdns_etcd_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:48.790 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_process_dead 2024-12-31 18:20:48.790 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_process_dead 2024-12-31 18:20:48.790 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_load1_per_cpu_over_threshold, expression load1_per_cpu > 2 2024-12-31 18:20:48.790 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_load1_per_cpu_over_threshold, expression load1_per_cpu > 1.5 2024-12-31 18:20:48.790 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_load1_per_cpu', labels={}}], alarmTargets 2024-12-31 18:20:48.790 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_load1_per_cpu_over_threshold 2024-12-31 18:20:48.790 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_load1_per_cpu_over_threshold 2024-12-31 18:20:48.791 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_meta_db_disconnected, expression ocp_meta_db_health == 0 2024-12-31 18:20:48.791 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_meta_db_health', labels={}}], alarmTargets 2024-12-31 18:20:48.791 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_meta_db_disconnected 2024-12-31 18:20:48.791 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_meta_db_disconnected 2024-12-31 18:20:48.791 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_host_cpu_usage_over_threshold, expression binlog_host_cpu_usage > 90 2024-12-31 18:20:48.791 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_host_cpu_usage', labels={}}], alarmTargets 2024-12-31 18:20:48.791 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_host_cpu_usage_over_threshold 2024-12-31 18:20:48.791 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_host_cpu_usage_over_threshold 2024-12-31 18:20:48.791 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_http_request_too_many_errors_occur, expression ocp_http_request_error_count >= 1 2024-12-31 18:20:48.791 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_http_request_error_count', labels={}}], alarmTargets 2024-12-31 18:20:48.791 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_http_request_too_many_errors_occur 2024-12-31 18:20:48.791 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_http_request_too_many_errors_occur 2024-12-31 18:20:48.792 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_process_stop, expression obproxy_boot_time_delta_seconds > 0 2024-12-31 18:20:48.792 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.792 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_process_stop 2024-12-31 18:20:48.792 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_process_stop 2024-12-31 18:20:48.792 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_compaction_error, expression compaction_is_error == 1 2024-12-31 18:20:48.792 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_compaction_error_flag', labels={}}], alarmTargets 2024-12-31 18:20:48.792 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_compaction_error 2024-12-31 18:20:48.792 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_compaction_error 2024-12-31 18:20:48.792 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_dump_error, expression binlog_dump_error_count > 10 2024-12-31 18:20:48.792 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_dump_error_count', labels={}}], alarmTargets 2024-12-31 18:20:48.792 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_dump_error 2024-12-31 18:20:48.792 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_dump_error 2024-12-31 18:20:48.792 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for host_disk_readonly, expression disk_readonly_flag == 1 2024-12-31 18:20:48.793 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_disk_readonly_flag', labels={}}], alarmTargets 2024-12-31 18:20:48.793 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_disk_readonly 2024-12-31 18:20:48.793 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_disk_readonly 2024-12-31 18:20:48.793 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_sync_delay_time_too_long, expression sync_delay_time > 600 2024-12-31 18:20:48.793 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_sync_delay_time', labels={}}], alarmTargets 2024-12-31 18:20:48.793 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_delay_time_too_long 2024-12-31 18:20:48.793 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_sync_delay_time_too_long 2024-12-31 18:20:48.793 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_http_request_timeout, expression ocp_http_request_duration_seconds >= 5 2024-12-31 18:20:48.793 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_http_request_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.793 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_http_request_timeout 2024-12-31 18:20:48.793 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_http_request_timeout 2024-12-31 18:20:48.793 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_cpu_percent_over_threshold, expression ob_tenant_thread_percent > 80 2024-12-31 18:20:48.794 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_cpu_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.794 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_cpu_percent_over_threshold 2024-12-31 18:20:48.794 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-tenant_cpu_percent_over_threshold 2024-12-31 18:20:48.794 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_keepalived_service_inactive, expression keepalived_process_exists == 0 or keepalived_up_status == 0 2024-12-31 18:20:48.794 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_keepalived_up_status', labels={}}, Metric{name='oblb_keepalived_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:48.794 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_keepalived_service_inactive 2024-12-31 18:20:48.794 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_keepalived_service_inactive 2024-12-31 18:20:48.794 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_leader_absent, expression etcd_leader_count != 1 2024-12-31 18:20:48.794 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_leader_count', labels={}}], alarmTargets 2024-12-31 18:20:48.794 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_leader_absent 2024-12-31 18:20:48.794 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_leader_absent 2024-12-31 18:20:48.795 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_data_disk_percent_over_threshold, expression ob_data_disk_usage_percent > 97 2024-12-31 18:20:48.795 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_data_path_disk_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.795 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_data_disk_percent_over_threshold 2024-12-31 18:20:48.795 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_data_disk_percent_over_threshold 2024-12-31 18:20:48.795 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_keepalived_become_master, expression keepalived_become_master_count > 0 2024-12-31 18:20:48.795 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_keepalived_become_master_count', labels={}}], alarmTargets 2024-12-31 18:20:48.796 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_keepalived_become_master 2024-12-31 18:20:48.796 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_keepalived_become_master 2024-12-31 18:20:48.796 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for host_process_cpu_bind_core_is_invalid, expression host_process_cpu_bind_core_alarm_status == 1 2024-12-31 18:20:48.796 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_process_cpu_bind_core_alarm_status', labels={}}], alarmTargets 2024-12-31 18:20:48.796 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_process_cpu_bind_core_is_invalid 2024-12-31 18:20:48.796 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_process_cpu_bind_core_is_invalid 2024-12-31 18:20:48.796 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for agent_process_count_abnormal, expression agent_process_count != 1 2024-12-31 18:20:48.796 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='agent_process_count', labels={}}], alarmTargets 2024-12-31 18:20:48.796 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=agent_process_count_abnormal 2024-12-31 18:20:48.796 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-agent_process_count_abnormal 2024-12-31 18:20:48.797 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_log_disk_usage_high, expression ob_tenant_log_disk_usage > 85 2024-12-31 18:20:48.797 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_log_disk_usage', labels={}}], alarmTargets 2024-12-31 18:20:48.797 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_log_disk_usage_high 2024-12-31 18:20:48.797 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_log_disk_usage_high 2024-12-31 18:20:48.797 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_service_name_is_invalid, expression ob_tenant_service_name_status == 1 2024-12-31 18:20:48.797 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_service_name_status', labels={}}], alarmTargets 2024-12-31 18:20:48.797 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_service_name_is_invalid 2024-12-31 18:20:48.797 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_service_name_is_invalid 2024-12-31 18:20:48.797 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_service_instance_abnormal, expression binlog_instance_down > 0 2024-12-31 18:20:48.797 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_instance_down', labels={}}], alarmTargets 2024-12-31 18:20:48.798 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_service_instance_abnormal 2024-12-31 18:20:48.798 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_service_instance_abnormal 2024-12-31 18:20:48.798 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_process_dead, expression obdns_process_exists == 0 or obdns_service_connectable == 0 2024-12-31 18:20:48.798 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_service_connectable', labels={}}, Metric{name='obdns_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:48.798 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_process_dead 2024-12-31 18:20:48.798 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_process_dead 2024-12-31 18:20:48.798 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_merge_error, expression merge_error_flag == 1 2024-12-31 18:20:48.798 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_merge_error_flag', labels={}}], alarmTargets 2024-12-31 18:20:48.798 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_error 2024-12-31 18:20:48.798 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_merge_error 2024-12-31 18:20:48.798 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_observer_not_exist, expression observer_process_exists == 0 2024-12-31 18:20:48.799 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_observer_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:48.799 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_not_exist 2024-12-31 18:20:48.799 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_observer_not_exist 2024-12-31 18:20:48.799 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for host_agent_open_fd_count_over_threshold, expression host_agent_open_fd_count > 1000 2024-12-31 18:20:48.799 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_open_fd_count', labels={}}], alarmTargets 2024-12-31 18:20:48.799 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_open_fd_count_over_threshold 2024-12-31 18:20:48.799 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_agent_open_fd_count_over_threshold 2024-12-31 18:20:48.800 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for backup_storage_capacity_timeout_or_interrupted, expression storage_capacity_monitor_error_code == 1002 2024-12-31 18:20:48.800 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='storage_capacity_monitor_error_code', labels={}}], alarmTargets 2024-12-31 18:20:48.800 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_timeout_or_interrupted 2024-12-31 18:20:48.800 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-backup_storage_capacity_timeout_or_interrupted 2024-12-31 18:20:48.800 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_net_recv_percent_over_threshold, expression net_recv_percent > 80 and eth_net_bandwidth_mbps > 0 2024-12-31 18:20:48.800 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='ob_host_net_recv_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.800 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_recv_percent_over_threshold 2024-12-31 18:20:48.800 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_net_recv_percent_over_threshold 2024-12-31 18:20:48.800 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_cannot_connect_to_leader, expression etcd_leader_connectable == 0 2024-12-31 18:20:48.800 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_leader_connectable', labels={}}], alarmTargets 2024-12-31 18:20:48.800 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_cannot_connect_to_leader 2024-12-31 18:20:48.800 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_cannot_connect_to_leader 2024-12-31 18:20:48.801 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_collect_metric_failure_rate_high, expression collect_metric_failure_rate > 10 2024-12-31 18:20:48.801 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_collect_metric_failure_rate', labels={}}], alarmTargets 2024-12-31 18:20:48.801 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_collect_metric_failure_rate_high 2024-12-31 18:20:48.801 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_collect_metric_failure_rate_high 2024-12-31 18:20:48.801 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_leader_switched, expression etcd_leader_switch_count > 0 2024-12-31 18:20:48.801 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_leader_switch_count', labels={}}], alarmTargets 2024-12-31 18:20:48.801 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_leader_switched 2024-12-31 18:20:48.801 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_leader_switched 2024-12-31 18:20:48.801 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxyd_process_dead, expression obproxyd_process_exists == 0 2024-12-31 18:20:48.802 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxyd_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:48.802 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxyd_process_dead 2024-12-31 18:20:48.802 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxyd_process_dead 2024-12-31 18:20:48.802 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_install_disk_percent_over_threshold, expression ob_install_disk_usage_percent > 97 2024-12-31 18:20:48.802 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_install_disk_percent_over_threshold, expression ob_install_disk_usage_percent > 95 2024-12-31 18:20:48.802 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_install_path_disk_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.802 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_install_disk_percent_over_threshold 2024-12-31 18:20:48.802 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_install_disk_percent_over_threshold 2024-12-31 18:20:48.802 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_no_frozen, expression no_frozen_time > 90000 2024-12-31 18:20:48.802 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_no_frozen_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.802 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_frozen 2024-12-31 18:20:48.802 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_no_frozen 2024-12-31 18:20:48.803 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_frozen_version_delta_over_threshold, expression frozen_versions > 1 2024-12-31 18:20:48.803 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_frozen_version_delta', labels={}}], alarmTargets 2024-12-31 18:20:48.803 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_frozen_version_delta_over_threshold 2024-12-31 18:20:48.803 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_frozen_version_delta_over_threshold 2024-12-31 18:20:48.803 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_service_disk_usage_over_threshold, expression binlog_service_disk_usage > 90 2024-12-31 18:20:48.803 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_service_disk_usage', labels={}}], alarmTargets 2024-12-31 18:20:48.803 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_service_disk_usage_over_threshold 2024-12-31 18:20:48.803 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_service_disk_usage_over_threshold 2024-12-31 18:20:48.803 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_core_dump, expression obproxy_core_dump_seconds < 1200 and obproxy_core_dump_seconds > 0 2024-12-31 18:20:48.803 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_core_dump_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.803 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_core_dump 2024-12-31 18:20:48.803 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_core_dump 2024-12-31 18:20:48.804 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_process_dead, expression obproxy_process_exists == 0 2024-12-31 18:20:48.804 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:48.804 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_process_dead 2024-12-31 18:20:48.804 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_process_dead 2024-12-31 18:20:48.804 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for node_file_root_usage, expression root_disk_usage > 95 2024-12-31 18:20:48.804 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_root_disk_usage', labels={}}], alarmTargets 2024-12-31 18:20:48.804 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_root_usage 2024-12-31 18:20:48.804 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-node_file_root_usage 2024-12-31 18:20:48.805 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_memory_peak, expression obproxy_rss_mem_used_percent > 90 2024-12-31 18:20:48.805 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_rss_mem_used_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.805 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_memory_peak 2024-12-31 18:20:48.805 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_memory_peak 2024-12-31 18:20:48.805 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_no_frozen, expression no_frozen_seconds > 90000 2024-12-31 18:20:48.805 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_no_frozen_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.805 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_frozen 2024-12-31 18:20:48.805 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_no_frozen 2024-12-31 18:20:48.805 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_observer_core_dump, expression observer_core_dump_seconds < 1200 and observer_core_dump_seconds > 0 2024-12-31 18:20:48.805 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_observer_core_dump_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.806 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_core_dump 2024-12-31 18:20:48.806 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_observer_core_dump 2024-12-31 18:20:48.806 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_partition_replica_absent, expression tenant_partition_replica_absent_count > 100 2024-12-31 18:20:48.806 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_partition_replica_absent_count', labels={}}], alarmTargets 2024-12-31 18:20:48.806 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_partition_replica_absent 2024-12-31 18:20:48.806 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_partition_replica_absent 2024-12-31 18:20:48.806 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for monitor_exporter_unavaliable, expression monitor_exporter_avaliable == 0 2024-12-31 18:20:48.806 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='monitor_exporter_avaliable', labels={}}], alarmTargets 2024-12-31 18:20:48.806 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=monitor_exporter_unavaliable 2024-12-31 18:20:48.806 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-monitor_exporter_unavaliable 2024-12-31 18:20:48.806 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for os_kernel_io_hang, expression io_util >= 99 and io_qusize >= 20 and io_read_write_time == 0 2024-12-31 18:20:48.807 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_io_qusize', labels={}}, Metric{name='ob_host_io_util', labels={}}, Metric{name='ob_host_io_read_write_time', labels={}}], alarmTargets 2024-12-31 18:20:48.807 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_kernel_io_hang 2024-12-31 18:20:48.807 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_kernel_io_hang 2024-12-31 18:20:48.807 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_client_connections_usage_over_threshold, expression client_connection_used_percent > 85 2024-12-31 18:20:48.807 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_client_connections_usage', labels={}}], alarmTargets 2024-12-31 18:20:48.807 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_client_connections_usage_over_threshold 2024-12-31 18:20:48.807 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_client_connections_usage_over_threshold 2024-12-31 18:20:48.807 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_cpu_usage_over_threshold, expression ob_tenant_cpu_percent > 95 2024-12-31 18:20:48.807 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_real_cpu_percent', labels={}}], alarmTargets 2024-12-31 18:20:48.807 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_cpu_usage_over_threshold 2024-12-31 18:20:48.807 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_cpu_usage_over_threshold 2024-12-31 18:20:48.808 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for host_agent_res_memory_over_threshold, expression host_agent_resident_memory_gb > 1.5 2024-12-31 18:20:48.808 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_res_memory', labels={}}], alarmTargets 2024-12-31 18:20:48.808 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_res_memory_over_threshold 2024-12-31 18:20:48.808 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_agent_res_memory_over_threshold 2024-12-31 18:20:48.808 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for host_unavailable, expression host_available == 0 2024-12-31 18:20:48.808 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_available', labels={}}], alarmTargets 2024-12-31 18:20:48.808 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_unavailable 2024-12-31 18:20:48.808 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_unavailable 2024-12-31 18:20:48.808 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_task_timeout, expression ob_tenant_task_max_duration_seconds > 10800 2024-12-31 18:20:48.808 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_task_max_duration', labels={}}], alarmTargets 2024-12-31 18:20:48.808 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_task_timeout 2024-12-31 18:20:48.808 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_task_timeout 2024-12-31 18:20:48.809 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_disk_readonly, expression disk_readonly_flag == 1 2024-12-31 18:20:48.809 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_disk_readonly_flag', labels={}}], alarmTargets 2024-12-31 18:20:48.809 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_disk_readonly 2024-12-31 18:20:48.809 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_disk_readonly 2024-12-31 18:20:48.809 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_long_trans_exist, expression long_trans_max_duration_seconds > 1200 2024-12-31 18:20:48.809 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_long_trans_max_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:20:48.809 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_long_trans_exist 2024-12-31 18:20:48.809 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_long_trans_exist 2024-12-31 18:20:48.809 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_log_stream_degraded, expression ob_tenant_log_stream_degraded_count > 0 2024-12-31 18:20:48.809 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_log_stream_degraded_count', labels={}}], alarmTargets 2024-12-31 18:20:48.810 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_log_stream_degraded 2024-12-31 18:20:48.810 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_log_stream_degraded 2024-12-31 18:20:48.810 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for host_agent_goroutine_count_over_threshold, expression host_agent_goroutine_count > 3000 2024-12-31 18:20:48.810 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_goroutine_count', labels={}}], alarmTargets 2024-12-31 18:20:48.810 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_goroutine_count_over_threshold 2024-12-31 18:20:48.810 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_agent_goroutine_count_over_threshold 2024-12-31 18:20:48.810 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cannot_connected, expression ob_connectable == 0 2024-12-31 18:20:48.810 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_connectable', labels={}}], alarmTargets 2024-12-31 18:20:48.810 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cannot_connected 2024-12-31 18:20:48.810 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cannot_connected 2024-12-31 18:20:48.810 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_process_dead, expression etcd_process_exists == 0 or oblb_etcd_connectable == 0 2024-12-31 18:20:48.811 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_connectable', labels={}}, Metric{name='oblb_etcd_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:48.811 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_process_dead 2024-12-31 18:20:48.811 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_process_dead 2024-12-31 18:20:48.811 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_exists_inactive_server, expression inactive_server_count > 0 2024-12-31 18:20:48.811 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_inactive_server_count', labels={}}], alarmTargets 2024-12-31 18:20:48.811 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_inactive_server 2024-12-31 18:20:48.811 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_exists_inactive_server 2024-12-31 18:20:48.811 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_partition_count_over_threshold, expression partition_count > 30000 2024-12-31 18:20:48.811 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_partition_count', labels={}}], alarmTargets 2024-12-31 18:20:48.811 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_partition_count_over_threshold 2024-12-31 18:20:48.811 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_partition_count_over_threshold 2024-12-31 18:20:48.811 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_remote_server_time_diff_too_large, expression clock_diff_milliseconds > 50 2024-12-31 18:20:48.811 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_clock_diff_milliseconds', labels={}}], alarmTargets 2024-12-31 18:20:48.812 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_remote_server_time_diff_too_large 2024-12-31 18:20:48.812 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_remote_server_time_diff_too_large 2024-12-31 18:20:48.812 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_request_queue_over_threshold, expression ob_tenant_request_queue_size > 10 and request_queue_time > 1000 2024-12-31 18:20:48.812 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_request_queue_over_threshold, expression ob_tenant_request_queue_size > 100 2024-12-31 18:20:48.812 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_request_queue_time_us', labels={}}, Metric{name='ob_tenant_host_request_queue', labels={}}], alarmTargets 2024-12-31 18:20:48.812 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_request_queue_over_threshold 2024-12-31 18:20:48.812 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_request_queue_over_threshold 2024-12-31 18:20:48.812 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_exists_index_fail_table, expression index_fail_count > 0 2024-12-31 18:20:48.812 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_index_fail_count', labels={}}], alarmTargets 2024-12-31 18:20:48.813 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_index_fail_table 2024-12-31 18:20:48.813 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_exists_index_fail_table 2024-12-31 18:20:48.813 INFO 34018 --- [ocp-schedules-21,6207813cc3bd186e,aff1f756ea8d9af1] c.o.o.a.u.f.VersionalProductFactory : refresh done, configCount=129, updatedCount=129, failedToUpdateCount=0 2024-12-31 18:20:48.849 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:48.851 INFO 34018 --- [pool-11-thread-1,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:48.879 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:20:48.878998+08:00, lastProcessTime=2024-12-31T18:20:48.584209+08:00 2024-12-31 18:20:48.881 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:48.883 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:48.893 INFO 34018 --- [ocp-schedules-20,97493c0d096e636d,bdf2a13f311fca12] c.o.o.a.service.AlarmTargetServiceImpl : alarm targets changed, pre targets , current targets ,,,,,, 2024-12-31 18:20:48.914 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:48.915 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20250105 2024-12-31 18:20:48.916 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:48.916 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:20:49.012 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_merge_timeout, expression merge_timeout_flag == 1 2024-12-31 18:20:49.012 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_merge_timeout_flag', labels={}}], alarmTargets 2024-12-31 18:20:49.013 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_timeout 2024-12-31 18:20:49.013 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_merge_timeout 2024-12-31 18:20:49.013 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_traffic_drop, expression net_receive_drop_count > 100 2024-12-31 18:20:49.013 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_net_receive_drop_count', labels={}}], alarmTargets 2024-12-31 18:20:49.013 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_drop 2024-12-31 18:20:49.013 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_traffic_drop 2024-12-31 18:20:49.013 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_cannot_connect_arbitration, expression arbitration_status_inactive_server_count > 0 2024-12-31 18:20:49.013 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='arbitration_status_inactive_server_count', labels={}}], alarmTargets 2024-12-31 18:20:49.013 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_cannot_connect_arbitration 2024-12-31 18:20:49.013 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_server_cannot_connect_arbitration 2024-12-31 18:20:49.013 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_partition_leader_absent, expression tenant_partition_leader_absent_count > 100 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_partition_leader_absent_count', labels={}}], alarmTargets 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_partition_leader_absent 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_partition_leader_absent 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cpu_percent_over_threshold, expression ob_tenant_thread_percent > 80 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cpu_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cpu_percent_over_threshold 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cpu_percent_over_threshold 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_alarm_detect_timeout, expression ocp_alarm_detect_duration_seconds >= 3 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_alarm_detect_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_alarm_detect_timeout 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_alarm_detect_timeout 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for backup_storage_capacity_retry_times_exceeded, expression storage_capacity_monitor_error_code == 1001 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='storage_capacity_monitor_error_code', labels={}}], alarmTargets 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_retry_times_exceeded 2024-12-31 18:20:49.014 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-backup_storage_capacity_retry_times_exceeded 2024-12-31 18:20:49.015 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_log_disk_percent_over_threshold, expression ob_log_disk_usage_percent > 95 2024-12-31 18:20:49.015 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_log_disk_percent_over_threshold, expression ob_log_disk_usage_percent > 92 2024-12-31 18:20:49.015 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_log_path_disk_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.015 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_log_disk_percent_over_threshold 2024-12-31 18:20:49.015 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_log_disk_percent_over_threshold 2024-12-31 18:20:49.015 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_cpu_util_hwm, expression cpu_used_percent > 90 and cpu_steal < 20 2024-12-31 18:20:49.015 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_cpu_steal', labels={}}, Metric{name='host_cpu_used_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.015 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_hwm 2024-12-31 18:20:49.015 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_cpu_util_hwm 2024-12-31 18:20:49.015 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_nic_1000m_hwm, expression eth_net_traffic_usage > 80 and eth_net_bandwidth_mbps < 300 and eth_net_bandwidth_mbps > 0 2024-12-31 18:20:49.015 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='host_eth_net_traffic_usage', labels={}}], alarmTargets 2024-12-31 18:20:49.016 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_hwm 2024-12-31 18:20:49.016 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_nic_1000m_hwm 2024-12-31 18:20:49.016 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_cannot_connected, expression obproxy_connectable == 0 2024-12-31 18:20:49.016 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_connectable', labels={}}], alarmTargets 2024-12-31 18:20:49.016 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_cannot_connected 2024-12-31 18:20:49.016 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_cannot_connected 2024-12-31 18:20:49.016 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_recyclebin_disk_used_over_threshold, expression ob_database_disk_used_gb > 100 2024-12-31 18:20:49.016 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_recyclebin_disk_used_gb', labels={}}], alarmTargets 2024-12-31 18:20:49.016 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_recyclebin_disk_used_over_threshold 2024-12-31 18:20:49.016 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_recyclebin_disk_used_over_threshold 2024-12-31 18:20:49.016 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_cannot_connect_to_leader, expression etcd_leader_connectable == 0 2024-12-31 18:20:49.017 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_leader_connectable', labels={}}], alarmTargets 2024-12-31 18:20:49.017 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_cannot_connect_to_leader 2024-12-31 18:20:49.017 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_cannot_connect_to_leader 2024-12-31 18:20:49.017 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_net_send_percent_over_threshold, expression net_send_percent > 80 and eth_net_bandwidth_mbps > 0 2024-12-31 18:20:49.017 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='ob_host_net_send_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.017 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_send_percent_over_threshold 2024-12-31 18:20:49.017 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_net_send_percent_over_threshold 2024-12-31 18:20:49.017 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_sda_ioawait, expression io_await >= 200 and io_util >= 99 2024-12-31 18:20:49.017 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_io_await', labels={}}, Metric{name='ob_host_io_util', labels={}}], alarmTargets 2024-12-31 18:20:49.017 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_sda_ioawait 2024-12-31 18:20:49.017 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_sda_ioawait 2024-12-31 18:20:49.018 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for refresh_location_cache_failed_by_metric, expression location_cache_log_count > 0 and location_cache_success_count == 0 and location_cache_sql_success_count == 0 2024-12-31 18:20:49.018 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_location_cache_log_count', labels={}}, Metric{name='ob_cluster_location_cache_success_count', labels={}}, Metric{name='ob_cluster_location_cache_sql_success_count', labels={}}], alarmTargets 2024-12-31 18:20:49.018 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=refresh_location_cache_failed_by_metric 2024-12-31 18:20:49.018 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-refresh_location_cache_failed_by_metric 2024-12-31 18:20:49.018 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_nvme_ioawait, expression io_await > 20 and io_util >= 98 and io_qusize >= 20 2024-12-31 18:20:49.018 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_io_qusize', labels={}}, Metric{name='ob_host_io_await', labels={}}, Metric{name='ob_host_io_util', labels={}}], alarmTargets 2024-12-31 18:20:49.018 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_nvme_ioawait 2024-12-31 18:20:49.018 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_nvme_ioawait 2024-12-31 18:20:49.019 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ic_server_connect_failed, expression ic_server_health == 0 2024-12-31 18:20:49.019 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ic_server_health', labels={}}], alarmTargets 2024-12-31 18:20:49.019 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ic_server_connect_failed 2024-12-31 18:20:49.019 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ic_server_connect_failed 2024-12-31 18:20:49.019 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_sync_failed, expression ob_cluster_sync == 0 2024-12-31 18:20:49.019 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_sync', labels={}}], alarmTargets 2024-12-31 18:20:49.019 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_failed 2024-12-31 18:20:49.019 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_sync_failed 2024-12-31 18:20:49.019 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_process_dead, expression oblb_process_exists == 0 or oblb_service_connectable == 0 2024-12-31 18:20:49.019 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_process_exists', labels={}}, Metric{name='oblb_service_connectable', labels={}}], alarmTargets 2024-12-31 18:20:49.020 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_process_dead 2024-12-31 18:20:49.020 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_process_dead 2024-12-31 18:20:49.020 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_traffic_error, expression net_traffic_err_count > 100 2024-12-31 18:20:49.020 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_net_traffic_err_count', labels={}}], alarmTargets 2024-12-31 18:20:49.020 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_error 2024-12-31 18:20:49.020 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_traffic_error 2024-12-31 18:20:49.020 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_memstore_percent_over_threshold, expression memstore_percent > 95 2024-12-31 18:20:49.020 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_memstore_percent_over_threshold, expression memstore_percent > 85 2024-12-31 18:20:49.021 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_memstore_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.021 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_memstore_percent_over_threshold 2024-12-31 18:20:49.021 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-tenant_memstore_percent_over_threshold 2024-12-31 18:20:49.021 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_node_status_abnormal, expression binlog_node_available == 0 2024-12-31 18:20:49.021 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_node_available', labels={}}], alarmTargets 2024-12-31 18:20:49.021 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_node_status_abnormal 2024-12-31 18:20:49.021 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_node_status_abnormal 2024-12-31 18:20:49.021 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_nic_usage_over_threshold, expression oblb_net_traffic_usage > 80 and net_bandwidth_mbps > 0 2024-12-31 18:20:49.021 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_net_traffic_usage', labels={}}, Metric{name='net_bandwidth_mbps', labels={}}], alarmTargets 2024-12-31 18:20:49.021 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_nic_usage_over_threshold 2024-12-31 18:20:49.021 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_nic_usage_over_threshold 2024-12-31 18:20:49.021 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_ip_forward_invalid, expression oblb_ip_forward_status != 1 2024-12-31 18:20:49.022 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_ip_forward_status', labels={}}], alarmTargets 2024-12-31 18:20:49.022 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_ip_forward_invalid 2024-12-31 18:20:49.022 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_ip_forward_invalid 2024-12-31 18:20:49.022 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for arbitration_service_unavailable, expression arbitration_service_available == 0 2024-12-31 18:20:49.022 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='arbitration_service_available', labels={}}], alarmTargets 2024-12-31 18:20:49.022 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=arbitration_service_unavailable 2024-12-31 18:20:49.022 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-arbitration_service_unavailable 2024-12-31 18:20:49.022 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_active_memstore_percent_over_threshold, expression active_memstore_percent > 110 2024-12-31 18:20:49.022 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_active_memstore_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.022 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_active_memstore_percent_over_threshold 2024-12-31 18:20:49.022 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-tenant_active_memstore_percent_over_threshold 2024-12-31 18:20:49.023 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_service_conversion_delay, expression binlog_conversion_delay > 10000 2024-12-31 18:20:49.023 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_conversion_delay', labels={}}], alarmTargets 2024-12-31 18:20:49.023 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_service_conversion_delay 2024-12-31 18:20:49.023 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_service_conversion_delay 2024-12-31 18:20:49.023 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obagent_dead, expression host_agent_process_status == 0 2024-12-31 18:20:49.023 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_process_status', labels={}}], alarmTargets 2024-12-31 18:20:49.023 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obagent_dead 2024-12-31 18:20:49.023 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obagent_dead 2024-12-31 18:20:49.023 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_host_memory_usage_over_threshold, expression binlog_host_memory_usage > 90 2024-12-31 18:20:49.023 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_host_memory_usage', labels={}}], alarmTargets 2024-12-31 18:20:49.023 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_host_memory_usage_over_threshold 2024-12-31 18:20:49.023 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_host_memory_usage_over_threshold 2024-12-31 18:20:49.023 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for monagent_process_stop, expression monagent_boot_time_delta_seconds > 0 2024-12-31 18:20:49.024 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='monagent_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.024 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=monagent_process_stop 2024-12-31 18:20:49.024 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-monagent_process_stop 2024-12-31 18:20:49.024 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for mgragent_process_stop, expression mgragent_boot_time_delta_seconds > 0 2024-12-31 18:20:49.024 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='mgragent_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.024 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=mgragent_process_stop 2024-12-31 18:20:49.024 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-mgragent_process_stop 2024-12-31 18:20:49.024 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_nic_1000m_full, expression eth_net_traffic_usage > 92 and eth_net_bandwidth_mbps < 300 and eth_net_bandwidth_mbps > 0 2024-12-31 18:20:49.024 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='host_eth_net_traffic_usage', labels={}}], alarmTargets 2024-12-31 18:20:49.024 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_full 2024-12-31 18:20:49.024 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_nic_1000m_full 2024-12-31 18:20:49.024 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_monitordb_disconnected, expression monitordb_connectable == 0 2024-12-31 18:20:49.025 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='monitordb_connectable', labels={}}], alarmTargets 2024-12-31 18:20:49.025 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_monitordb_disconnected 2024-12-31 18:20:49.025 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_monitordb_disconnected 2024-12-31 18:20:49.025 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxyd_process_stop, expression obproxyd_boot_time_delta_seconds > 0 2024-12-31 18:20:49.025 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxyd_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.025 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxyd_process_stop 2024-12-31 18:20:49.025 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxyd_process_stop 2024-12-31 18:20:49.025 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_host_storage_usage_over_threshold, expression binlog_host_storage_usage > 90 2024-12-31 18:20:49.025 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_host_storage_usage', labels={}}], alarmTargets 2024-12-31 18:20:49.025 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_host_storage_usage_over_threshold 2024-12-31 18:20:49.025 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_host_storage_usage_over_threshold 2024-12-31 18:20:49.025 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant500_mem_hold_percent_over_threshold, expression tenant500_mem_hold_percent > 95 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant500_mem_hold_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_percent_over_threshold 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant500_mem_hold_percent_over_threshold 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for vpc_connect_failed, expression vpc_network_health == 0 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='vpc_network_health', labels={}}], alarmTargets 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=vpc_connect_failed 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-vpc_connect_failed 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_observer_fd_usage, expression observer_fd_usage > 65 and observer_fd_count > 0 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_observer_fd_count', labels={}}, Metric{name='ob_host_observer_fd_usage', labels={}}], alarmTargets 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_fd_usage 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_observer_fd_usage 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_sstable_percent_over_threshold, expression ob_disk_percent > 97 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_sstable_percent_over_threshold, expression ob_disk_percent > 85 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_server_disk_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_sstable_percent_over_threshold 2024-12-31 18:20:49.026 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_server_sstable_percent_over_threshold 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_leader_absent, expression etcd_leader_count != 1 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_leader_count', labels={}}], alarmTargets 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_leader_absent 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_leader_absent 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant500_mem_hold_over_threshold, expression tenant500_mem_hold > 100 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant500_mem_hold_gigabyte', labels={}}], alarmTargets 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_over_threshold 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant500_mem_hold_over_threshold 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_exists_expired_xa_trans, expression xa_trans_max_duration_seconds > 1200 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_xa_trans_max_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_exists_expired_xa_trans 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_exists_expired_xa_trans 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for agentd_process_stop, expression agentd_boot_time_delta_seconds > 0 2024-12-31 18:20:49.027 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='agentd_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=agentd_process_stop 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-agentd_process_stop 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_no_merge, expression no_merge_time > 108000 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_no_merge_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_merge 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_no_merge 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_no_compaction, expression no_compaction_seconds > 108000 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_no_compaction_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_compaction 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_no_compaction 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_traffic_overload, expression eth_net_traffic_usage > 80 and eth_net_bandwidth_mbps > 0 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='host_eth_net_traffic_usage', labels={}}], alarmTargets 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_overload 2024-12-31 18:20:49.028 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_traffic_overload 2024-12-31 18:20:49.029 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_mem_percent_over_threshold, expression memory_percent > 97 2024-12-31 18:20:49.029 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_mem_percent_over_threshold, expression memory_percent > 95 2024-12-31 18:20:49.029 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_mem_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.029 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_mem_percent_over_threshold 2024-12-31 18:20:49.029 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_mem_percent_over_threshold 2024-12-31 18:20:49.029 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_connection_percent_over_threshold, expression ob_connection_percent > 80 2024-12-31 18:20:49.029 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_connection_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.029 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_connection_percent_over_threshold 2024-12-31 18:20:49.029 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_connection_percent_over_threshold 2024-12-31 18:20:49.029 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for observer_process_stop, expression observer_boot_time_delta_seconds > 0 2024-12-31 18:20:49.030 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='observer_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.030 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=observer_process_stop 2024-12-31 18:20:49.030 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-observer_process_stop 2024-12-31 18:20:49.030 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_stopped, expression ob_server_stopped_duration_seconds > 0 2024-12-31 18:20:49.030 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_stopped_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.030 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_stopped 2024-12-31 18:20:49.030 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_server_stopped 2024-12-31 18:20:49.030 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for host_ntp_offset_too_large, expression ntp_offset_milliseconds > 100 2024-12-31 18:20:49.030 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for host_ntp_offset_too_large, expression ntp_offset_milliseconds > 50 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_ntp_offset_milliseconds', labels={}}], alarmTargets 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_offset_too_large 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_ntp_offset_too_large 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for node_file_inode_usage, expression file_inode_usage > 80 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_file_inode_usage', labels={}}], alarmTargets 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_inode_usage 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-node_file_inode_usage 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for standby_tenant_sync_delay_too_long, expression standby_tenant_delay_seconds >= 600 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='standby_tenant_delay_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=standby_tenant_sync_delay_too_long 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-standby_tenant_sync_delay_too_long 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_expired_trans_exist, expression pending_trans_max_duration_seconds > 1200 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_pending_trans_max_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_expired_trans_exist 2024-12-31 18:20:49.031 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_expired_trans_exist 2024-12-31 18:20:49.032 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_large_trans_exist, expression trans_max_log_size_mb > 102400 2024-12-31 18:20:49.032 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_trans_max_log_size_mb', labels={}}], alarmTargets 2024-12-31 18:20:49.032 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_large_trans_exist 2024-12-31 18:20:49.032 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_large_trans_exist 2024-12-31 18:20:49.032 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant500_storage_short_meta_mem_hold_high, expression tenant500_storage_short_meta_hold_percentage > 30 and tenant500_storage_short_meta_hold_gb > 0 2024-12-31 18:20:49.032 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant500_storage_short_meta_hold_gb', labels={}}, Metric{name='tenant500_storage_short_meta_hold_percentage', labels={}}], alarmTargets 2024-12-31 18:20:49.032 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_storage_short_meta_mem_hold_high 2024-12-31 18:20:49.032 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant500_storage_short_meta_mem_hold_high 2024-12-31 18:20:49.032 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_cpu_util_full, expression cpu_used_percent >= 98 2024-12-31 18:20:49.032 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_cpu_used_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.032 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_full 2024-12-31 18:20:49.032 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_cpu_util_full 2024-12-31 18:20:49.032 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_leader_switched, expression etcd_leader_switch_count > 0 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_leader_switch_count', labels={}}], alarmTargets 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_leader_switched 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_leader_switched 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for host_ntp_service_not_exist, expression ntp_service_exist == 0 or ntp_service_available == 0 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_ntp_service_exist', labels={}}, Metric{name='host_ntp_service_available', labels={}}], alarmTargets 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_service_not_exist 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_ntp_service_not_exist 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for standby_tenant_sync_status_error, expression standby_tenant_restore_status_code == 2 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for standby_tenant_sync_status_error, expression standby_tenant_restore_status_code == 1 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='standby_tenant_restore_status_code', labels={}}], alarmTargets 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=standby_tenant_sync_status_error 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-standby_tenant_sync_status_error 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_task_timeout, expression ob_server_task_max_duration_seconds > 10800 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_task_max_duration', labels={}}], alarmTargets 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_task_timeout 2024-12-31 18:20:49.033 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_task_timeout 2024-12-31 18:20:49.034 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_cpu_sys_abnormal, expression cpu_system > 40 2024-12-31 18:20:49.034 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_cpu_system', labels={}}], alarmTargets 2024-12-31 18:20:49.034 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_sys_abnormal 2024-12-31 18:20:49.034 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_cpu_sys_abnormal 2024-12-31 18:20:49.034 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_status_check_failed, expression ob_cluster_status_check == 0 2024-12-31 18:20:49.034 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_status_check', labels={}}], alarmTargets 2024-12-31 18:20:49.034 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_status_check_failed 2024-12-31 18:20:49.034 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_status_check_failed 2024-12-31 18:20:49.034 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_invalid_disk_exists, expression ob_disk_invalid_count > 0 2024-12-31 18:20:49.035 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_server_invalid_disk_count', labels={}}], alarmTargets 2024-12-31 18:20:49.035 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_invalid_disk_exists 2024-12-31 18:20:49.035 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_invalid_disk_exists 2024-12-31 18:20:49.035 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_keepalived_master_switched, expression keepalived_release_master_count > 0 2024-12-31 18:20:49.035 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_keepalived_release_master_count', labels={}}], alarmTargets 2024-12-31 18:20:49.035 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_keepalived_master_switched 2024-12-31 18:20:49.035 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_keepalived_master_switched 2024-12-31 18:20:49.035 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_exists_inactive_server, expression oblb_inactive_server_count > 0 2024-12-31 18:20:49.035 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_inactive_server_count', labels={}}], alarmTargets 2024-12-31 18:20:49.035 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_exists_inactive_server 2024-12-31 18:20:49.035 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_exists_inactive_server 2024-12-31 18:20:49.035 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_tcp_retrans_percent_over_threshold, expression tcp_retrans_percent > 10 2024-12-31 18:20:49.036 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_tcp_retrans_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.036 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_tcp_retrans_percent_over_threshold 2024-12-31 18:20:49.036 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_tcp_retrans_percent_over_threshold 2024-12-31 18:20:49.036 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_cpu_percent_over_threshold, expression cpu_percent > 90 2024-12-31 18:20:49.036 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_cpu_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.036 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_cpu_percent_over_threshold 2024-12-31 18:20:49.036 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_cpu_percent_over_threshold 2024-12-31 18:20:49.036 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_process_dead, expression obdns_etcd_process_exists == 0 or obdns_etcd_connectable == 0 2024-12-31 18:20:49.036 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_connectable', labels={}}, Metric{name='obdns_etcd_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:49.036 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_process_dead 2024-12-31 18:20:49.036 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_process_dead 2024-12-31 18:20:49.037 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_load1_per_cpu_over_threshold, expression load1_per_cpu > 2 2024-12-31 18:20:49.037 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_load1_per_cpu_over_threshold, expression load1_per_cpu > 1.5 2024-12-31 18:20:49.037 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_load1_per_cpu', labels={}}], alarmTargets 2024-12-31 18:20:49.037 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_load1_per_cpu_over_threshold 2024-12-31 18:20:49.037 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_load1_per_cpu_over_threshold 2024-12-31 18:20:49.037 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_meta_db_disconnected, expression ocp_meta_db_health == 0 2024-12-31 18:20:49.037 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_meta_db_health', labels={}}], alarmTargets 2024-12-31 18:20:49.037 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_meta_db_disconnected 2024-12-31 18:20:49.037 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_meta_db_disconnected 2024-12-31 18:20:49.037 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_host_cpu_usage_over_threshold, expression binlog_host_cpu_usage > 90 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_host_cpu_usage', labels={}}], alarmTargets 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_host_cpu_usage_over_threshold 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_host_cpu_usage_over_threshold 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_http_request_too_many_errors_occur, expression ocp_http_request_error_count >= 1 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_http_request_error_count', labels={}}], alarmTargets 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_http_request_too_many_errors_occur 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_http_request_too_many_errors_occur 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_process_stop, expression obproxy_boot_time_delta_seconds > 0 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_process_stop 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_process_stop 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_compaction_error, expression compaction_is_error == 1 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_compaction_error_flag', labels={}}], alarmTargets 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_compaction_error 2024-12-31 18:20:49.038 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_compaction_error 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_dump_error, expression binlog_dump_error_count > 10 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_dump_error_count', labels={}}], alarmTargets 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_dump_error 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_dump_error 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for host_disk_readonly, expression disk_readonly_flag == 1 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_disk_readonly_flag', labels={}}], alarmTargets 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_disk_readonly 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_disk_readonly 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_sync_delay_time_too_long, expression sync_delay_time > 600 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_sync_delay_time', labels={}}], alarmTargets 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_delay_time_too_long 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_sync_delay_time_too_long 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_http_request_timeout, expression ocp_http_request_duration_seconds >= 5 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_http_request_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_http_request_timeout 2024-12-31 18:20:49.039 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_http_request_timeout 2024-12-31 18:20:49.040 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_cpu_percent_over_threshold, expression ob_tenant_thread_percent > 80 2024-12-31 18:20:49.040 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_cpu_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.040 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_cpu_percent_over_threshold 2024-12-31 18:20:49.040 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-tenant_cpu_percent_over_threshold 2024-12-31 18:20:49.040 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_keepalived_service_inactive, expression keepalived_process_exists == 0 or keepalived_up_status == 0 2024-12-31 18:20:49.040 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_keepalived_up_status', labels={}}, Metric{name='oblb_keepalived_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:49.040 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_keepalived_service_inactive 2024-12-31 18:20:49.040 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_keepalived_service_inactive 2024-12-31 18:20:49.040 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_leader_absent, expression etcd_leader_count != 1 2024-12-31 18:20:49.040 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_leader_count', labels={}}], alarmTargets 2024-12-31 18:20:49.040 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_leader_absent 2024-12-31 18:20:49.041 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_leader_absent 2024-12-31 18:20:49.041 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_data_disk_percent_over_threshold, expression ob_data_disk_usage_percent > 97 2024-12-31 18:20:49.041 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_data_path_disk_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.041 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_data_disk_percent_over_threshold 2024-12-31 18:20:49.041 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_data_disk_percent_over_threshold 2024-12-31 18:20:49.041 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_keepalived_become_master, expression keepalived_become_master_count > 0 2024-12-31 18:20:49.041 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_keepalived_become_master_count', labels={}}], alarmTargets 2024-12-31 18:20:49.041 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_keepalived_become_master 2024-12-31 18:20:49.041 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_keepalived_become_master 2024-12-31 18:20:49.041 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for host_process_cpu_bind_core_is_invalid, expression host_process_cpu_bind_core_alarm_status == 1 2024-12-31 18:20:49.041 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_process_cpu_bind_core_alarm_status', labels={}}], alarmTargets 2024-12-31 18:20:49.041 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_process_cpu_bind_core_is_invalid 2024-12-31 18:20:49.041 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_process_cpu_bind_core_is_invalid 2024-12-31 18:20:49.042 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for agent_process_count_abnormal, expression agent_process_count != 1 2024-12-31 18:20:49.042 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='agent_process_count', labels={}}], alarmTargets 2024-12-31 18:20:49.042 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=agent_process_count_abnormal 2024-12-31 18:20:49.042 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-agent_process_count_abnormal 2024-12-31 18:20:49.042 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_log_disk_usage_high, expression ob_tenant_log_disk_usage > 85 2024-12-31 18:20:49.042 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_log_disk_usage', labels={}}], alarmTargets 2024-12-31 18:20:49.043 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_log_disk_usage_high 2024-12-31 18:20:49.043 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_log_disk_usage_high 2024-12-31 18:20:49.043 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_service_name_is_invalid, expression ob_tenant_service_name_status == 1 2024-12-31 18:20:49.043 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_service_name_status', labels={}}], alarmTargets 2024-12-31 18:20:49.043 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_service_name_is_invalid 2024-12-31 18:20:49.043 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_service_name_is_invalid 2024-12-31 18:20:49.043 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_service_instance_abnormal, expression binlog_instance_down > 0 2024-12-31 18:20:49.043 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_instance_down', labels={}}], alarmTargets 2024-12-31 18:20:49.043 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_service_instance_abnormal 2024-12-31 18:20:49.043 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_service_instance_abnormal 2024-12-31 18:20:49.043 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_process_dead, expression obdns_process_exists == 0 or obdns_service_connectable == 0 2024-12-31 18:20:49.044 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_service_connectable', labels={}}, Metric{name='obdns_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:49.044 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_process_dead 2024-12-31 18:20:49.044 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_process_dead 2024-12-31 18:20:49.044 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_merge_error, expression merge_error_flag == 1 2024-12-31 18:20:49.044 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_merge_error_flag', labels={}}], alarmTargets 2024-12-31 18:20:49.044 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_error 2024-12-31 18:20:49.044 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_merge_error 2024-12-31 18:20:49.044 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_observer_not_exist, expression observer_process_exists == 0 2024-12-31 18:20:49.044 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_observer_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:49.044 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_not_exist 2024-12-31 18:20:49.044 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_observer_not_exist 2024-12-31 18:20:49.045 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for host_agent_open_fd_count_over_threshold, expression host_agent_open_fd_count > 1000 2024-12-31 18:20:49.045 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_open_fd_count', labels={}}], alarmTargets 2024-12-31 18:20:49.045 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_open_fd_count_over_threshold 2024-12-31 18:20:49.045 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_agent_open_fd_count_over_threshold 2024-12-31 18:20:49.045 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for backup_storage_capacity_timeout_or_interrupted, expression storage_capacity_monitor_error_code == 1002 2024-12-31 18:20:49.045 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='storage_capacity_monitor_error_code', labels={}}], alarmTargets 2024-12-31 18:20:49.045 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_timeout_or_interrupted 2024-12-31 18:20:49.045 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-backup_storage_capacity_timeout_or_interrupted 2024-12-31 18:20:49.045 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_net_recv_percent_over_threshold, expression net_recv_percent > 80 and eth_net_bandwidth_mbps > 0 2024-12-31 18:20:49.046 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='ob_host_net_recv_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.046 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_recv_percent_over_threshold 2024-12-31 18:20:49.046 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_net_recv_percent_over_threshold 2024-12-31 18:20:49.046 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_cannot_connect_to_leader, expression etcd_leader_connectable == 0 2024-12-31 18:20:49.046 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_leader_connectable', labels={}}], alarmTargets 2024-12-31 18:20:49.046 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_cannot_connect_to_leader 2024-12-31 18:20:49.046 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_cannot_connect_to_leader 2024-12-31 18:20:49.046 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_collect_metric_failure_rate_high, expression collect_metric_failure_rate > 10 2024-12-31 18:20:49.046 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_collect_metric_failure_rate', labels={}}], alarmTargets 2024-12-31 18:20:49.046 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_collect_metric_failure_rate_high 2024-12-31 18:20:49.046 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_collect_metric_failure_rate_high 2024-12-31 18:20:49.047 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_leader_switched, expression etcd_leader_switch_count > 0 2024-12-31 18:20:49.047 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_leader_switch_count', labels={}}], alarmTargets 2024-12-31 18:20:49.047 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_leader_switched 2024-12-31 18:20:49.047 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_leader_switched 2024-12-31 18:20:49.047 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxyd_process_dead, expression obproxyd_process_exists == 0 2024-12-31 18:20:49.047 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxyd_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:49.047 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxyd_process_dead 2024-12-31 18:20:49.047 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxyd_process_dead 2024-12-31 18:20:49.047 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_install_disk_percent_over_threshold, expression ob_install_disk_usage_percent > 97 2024-12-31 18:20:49.048 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_install_disk_percent_over_threshold, expression ob_install_disk_usage_percent > 95 2024-12-31 18:20:49.048 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_install_path_disk_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.048 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:20:48.878998+08:00 2024-12-31 18:20:49.048 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_install_disk_percent_over_threshold 2024-12-31 18:20:49.048 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_install_disk_percent_over_threshold 2024-12-31 18:20:49.048 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_no_frozen, expression no_frozen_time > 90000 2024-12-31 18:20:49.048 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_no_frozen_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.048 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_frozen 2024-12-31 18:20:49.048 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_no_frozen 2024-12-31 18:20:49.048 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_frozen_version_delta_over_threshold, expression frozen_versions > 1 2024-12-31 18:20:49.048 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_frozen_version_delta', labels={}}], alarmTargets 2024-12-31 18:20:49.049 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_frozen_version_delta_over_threshold 2024-12-31 18:20:49.049 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_frozen_version_delta_over_threshold 2024-12-31 18:20:49.049 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_service_disk_usage_over_threshold, expression binlog_service_disk_usage > 90 2024-12-31 18:20:49.049 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_service_disk_usage', labels={}}], alarmTargets 2024-12-31 18:20:49.049 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_service_disk_usage_over_threshold 2024-12-31 18:20:49.049 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_service_disk_usage_over_threshold 2024-12-31 18:20:49.049 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_core_dump, expression obproxy_core_dump_seconds < 1200 and obproxy_core_dump_seconds > 0 2024-12-31 18:20:49.049 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_core_dump_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.049 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_core_dump 2024-12-31 18:20:49.049 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_core_dump 2024-12-31 18:20:49.050 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_process_dead, expression obproxy_process_exists == 0 2024-12-31 18:20:49.050 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:49.050 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_process_dead 2024-12-31 18:20:49.050 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_process_dead 2024-12-31 18:20:49.050 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for node_file_root_usage, expression root_disk_usage > 95 2024-12-31 18:20:49.050 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_root_disk_usage', labels={}}], alarmTargets 2024-12-31 18:20:49.050 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_root_usage 2024-12-31 18:20:49.050 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-node_file_root_usage 2024-12-31 18:20:49.050 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_memory_peak, expression obproxy_rss_mem_used_percent > 90 2024-12-31 18:20:49.051 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_rss_mem_used_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.051 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_memory_peak 2024-12-31 18:20:49.051 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_memory_peak 2024-12-31 18:20:49.051 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_no_frozen, expression no_frozen_seconds > 90000 2024-12-31 18:20:49.051 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_no_frozen_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.051 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_frozen 2024-12-31 18:20:49.051 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_no_frozen 2024-12-31 18:20:49.051 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_observer_core_dump, expression observer_core_dump_seconds < 1200 and observer_core_dump_seconds > 0 2024-12-31 18:20:49.052 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_observer_core_dump_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.052 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_core_dump 2024-12-31 18:20:49.052 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_observer_core_dump 2024-12-31 18:20:49.052 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_partition_replica_absent, expression tenant_partition_replica_absent_count > 100 2024-12-31 18:20:49.052 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_partition_replica_absent_count', labels={}}], alarmTargets 2024-12-31 18:20:49.052 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_partition_replica_absent 2024-12-31 18:20:49.052 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_partition_replica_absent 2024-12-31 18:20:49.052 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for monitor_exporter_unavaliable, expression monitor_exporter_avaliable == 0 2024-12-31 18:20:49.052 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='monitor_exporter_avaliable', labels={}}], alarmTargets 2024-12-31 18:20:49.052 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=monitor_exporter_unavaliable 2024-12-31 18:20:49.052 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-monitor_exporter_unavaliable 2024-12-31 18:20:49.053 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for os_kernel_io_hang, expression io_util >= 99 and io_qusize >= 20 and io_read_write_time == 0 2024-12-31 18:20:49.053 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_io_qusize', labels={}}, Metric{name='ob_host_io_util', labels={}}, Metric{name='ob_host_io_read_write_time', labels={}}], alarmTargets 2024-12-31 18:20:49.053 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_kernel_io_hang 2024-12-31 18:20:49.053 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_kernel_io_hang 2024-12-31 18:20:49.053 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_client_connections_usage_over_threshold, expression client_connection_used_percent > 85 2024-12-31 18:20:49.053 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_client_connections_usage', labels={}}], alarmTargets 2024-12-31 18:20:49.053 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_client_connections_usage_over_threshold 2024-12-31 18:20:49.053 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_client_connections_usage_over_threshold 2024-12-31 18:20:49.053 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_cpu_usage_over_threshold, expression ob_tenant_cpu_percent > 95 2024-12-31 18:20:49.054 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_real_cpu_percent', labels={}}], alarmTargets 2024-12-31 18:20:49.054 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_cpu_usage_over_threshold 2024-12-31 18:20:49.054 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_cpu_usage_over_threshold 2024-12-31 18:20:49.054 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for host_agent_res_memory_over_threshold, expression host_agent_resident_memory_gb > 1.5 2024-12-31 18:20:49.054 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_res_memory', labels={}}], alarmTargets 2024-12-31 18:20:49.054 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_res_memory_over_threshold 2024-12-31 18:20:49.054 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_agent_res_memory_over_threshold 2024-12-31 18:20:49.054 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for host_unavailable, expression host_available == 0 2024-12-31 18:20:49.054 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_available', labels={}}], alarmTargets 2024-12-31 18:20:49.054 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_unavailable 2024-12-31 18:20:49.054 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_unavailable 2024-12-31 18:20:49.055 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_task_timeout, expression ob_tenant_task_max_duration_seconds > 10800 2024-12-31 18:20:49.055 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_task_max_duration', labels={}}], alarmTargets 2024-12-31 18:20:49.055 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_task_timeout 2024-12-31 18:20:49.055 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_task_timeout 2024-12-31 18:20:49.055 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_disk_readonly, expression disk_readonly_flag == 1 2024-12-31 18:20:49.055 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_disk_readonly_flag', labels={}}], alarmTargets 2024-12-31 18:20:49.055 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_disk_readonly 2024-12-31 18:20:49.055 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_disk_readonly 2024-12-31 18:20:49.055 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_long_trans_exist, expression long_trans_max_duration_seconds > 1200 2024-12-31 18:20:49.056 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_long_trans_max_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:20:49.056 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_long_trans_exist 2024-12-31 18:20:49.056 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_long_trans_exist 2024-12-31 18:20:49.056 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_log_stream_degraded, expression ob_tenant_log_stream_degraded_count > 0 2024-12-31 18:20:49.056 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_log_stream_degraded_count', labels={}}], alarmTargets 2024-12-31 18:20:49.056 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_log_stream_degraded 2024-12-31 18:20:49.056 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_log_stream_degraded 2024-12-31 18:20:49.056 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for host_agent_goroutine_count_over_threshold, expression host_agent_goroutine_count > 3000 2024-12-31 18:20:49.057 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_goroutine_count', labels={}}], alarmTargets 2024-12-31 18:20:49.057 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_goroutine_count_over_threshold 2024-12-31 18:20:49.057 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_agent_goroutine_count_over_threshold 2024-12-31 18:20:49.057 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cannot_connected, expression ob_connectable == 0 2024-12-31 18:20:49.057 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_connectable', labels={}}], alarmTargets 2024-12-31 18:20:49.057 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cannot_connected 2024-12-31 18:20:49.057 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cannot_connected 2024-12-31 18:20:49.057 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_process_dead, expression etcd_process_exists == 0 or oblb_etcd_connectable == 0 2024-12-31 18:20:49.057 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_connectable', labels={}}, Metric{name='oblb_etcd_process_exists', labels={}}], alarmTargets 2024-12-31 18:20:49.057 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_process_dead 2024-12-31 18:20:49.057 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_process_dead 2024-12-31 18:20:49.058 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_exists_inactive_server, expression inactive_server_count > 0 2024-12-31 18:20:49.058 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_inactive_server_count', labels={}}], alarmTargets 2024-12-31 18:20:49.058 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_inactive_server 2024-12-31 18:20:49.058 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_exists_inactive_server 2024-12-31 18:20:49.058 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_partition_count_over_threshold, expression partition_count > 30000 2024-12-31 18:20:49.058 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_partition_count', labels={}}], alarmTargets 2024-12-31 18:20:49.058 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_partition_count_over_threshold 2024-12-31 18:20:49.058 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_partition_count_over_threshold 2024-12-31 18:20:49.058 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_remote_server_time_diff_too_large, expression clock_diff_milliseconds > 50 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_clock_diff_milliseconds', labels={}}], alarmTargets 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_remote_server_time_diff_too_large 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_remote_server_time_diff_too_large 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_request_queue_over_threshold, expression ob_tenant_request_queue_size > 10 and request_queue_time > 1000 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_request_queue_over_threshold, expression ob_tenant_request_queue_size > 100 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_request_queue_time_us', labels={}}, Metric{name='ob_tenant_host_request_queue', labels={}}], alarmTargets 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_request_queue_over_threshold 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_request_queue_over_threshold 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_exists_index_fail_table, expression index_fail_count > 0 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_index_fail_count', labels={}}], alarmTargets 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_index_fail_table 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_exists_index_fail_table 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.o.a.u.f.VersionalProductFactory : refresh done, configCount=129, updatedCount=129, failedToUpdateCount=0 2024-12-31 18:20:49.059 INFO 34018 --- [ocp-schedules-17,6c8c641a9106b1f0,78ddf8aee305af20] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:20:49.386 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:49.387 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:49.424 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:49.426 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20250106 2024-12-31 18:20:49.426 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:49.427 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:20:49.925 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:49.926 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:49.966 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:49.967 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20250107 2024-12-31 18:20:49.968 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:49.969 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:20:50.468 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:50.470 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:50.496 WARN 34018 --- [ocp-async-9,8d19b1a85c960ab3,1dad146fcdd0aaf2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:50.496 INFO 34018 --- [ocp-async-9,d8d19ef6cceb177d,2080ce7fb08bafeb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:50.520 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:50.521 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sqltext, partition=P20250108 2024-12-31 18:20:50.522 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:50.523 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sqltext` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:20:51.062 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:51.064 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sqltext' and table_type='BASE TABLE' 2024-12-31 18:20:51.104 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sqltext 2024-12-31 18:20:51.106 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:51.106 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:20:51.107 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:51.108 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_dynamic_sql 2024-12-31 18:20:51.121 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241216 2024-12-31 18:20:51.122 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:51.123 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241216 values less than (1734393600000000)) 2024-12-31 18:20:51.348 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:51.350 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:51.395 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:51.396 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241217 2024-12-31 18:20:51.397 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:51.397 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241217 values less than (1734480000000000)) 2024-12-31 18:20:51.568 INFO 34018 --- [prometheus-minute-schedule-1,3162d420fb58a546,1ff47283cac9ae4d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:51.622 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:51.624 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:51.663 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:51.664 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241218 2024-12-31 18:20:51.664 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:51.665 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241218 values less than (1734566400000000)) 2024-12-31 18:20:51.851 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:51.854 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:51.876 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:51.878 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:51.889 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:20:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:20:51.919 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:51.920 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241219 2024-12-31 18:20:51.921 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:51.922 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241219 values less than (1734652800000000)) 2024-12-31 18:20:52.131 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:52.132 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:52.173 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:52.174 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241220 2024-12-31 18:20:52.175 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:52.175 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241220 values less than (1734739200000000)) 2024-12-31 18:20:52.405 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:52.407 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:52.441 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:52.442 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241221 2024-12-31 18:20:52.443 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:52.444 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241221 values less than (1734825600000000)) 2024-12-31 18:20:52.496 WARN 34018 --- [ocp-async-3,60cdd33c1e23d10b,9d1dff47318f1d85] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:52.496 INFO 34018 --- [ocp-async-1,ad8005ee730d90be,10d056894f2e2f7a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:52.657 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:52.658 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:52.698 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:52.699 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241222 2024-12-31 18:20:52.700 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:52.701 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241222 values less than (1734912000000000)) 2024-12-31 18:20:52.923 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:52.925 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:52.965 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:52.965 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241223 2024-12-31 18:20:52.966 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:52.967 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241223 values less than (1734998400000000)) 2024-12-31 18:20:53.216 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:53.218 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:53.262 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:53.263 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241224 2024-12-31 18:20:53.264 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:53.265 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241224 values less than (1735084800000000)) 2024-12-31 18:20:53.497 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:53.499 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:53.545 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:53.546 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241225 2024-12-31 18:20:53.547 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:53.548 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241225 values less than (1735171200000000)) 2024-12-31 18:20:53.767 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:53.769 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:53.814 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:53.815 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241226 2024-12-31 18:20:53.816 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:53.816 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:20:54.168 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:54.170 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:54.211 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:54.212 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241227 2024-12-31 18:20:54.213 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:54.214 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:20:54.448 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:54.450 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:54.484 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,468c19bef1979b8f,6a85302811b451f5] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=468c19bef1979b8f, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:20:54.484 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,9a217c68d2ead807,76a54274e36e17b3] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=9a217c68d2ead807, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:20:54.484 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,d1eba9af26516e10,3aa28ad35973df39] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=d1eba9af26516e10, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:20:54.485 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,fa848623996f0732,57ea4ab55261f122] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=fa848623996f0732, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:20:54.486 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,d1eba9af26516e10,3aa28ad35973df39] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=d1eba9af26516e10, duration=13 ms] 2024-12-31 18:20:54.486 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,468c19bef1979b8f,6a85302811b451f5] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=468c19bef1979b8f, duration=13 ms] 2024-12-31 18:20:54.487 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,fa848623996f0732,57ea4ab55261f122] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=fa848623996f0732, duration=14 ms] 2024-12-31 18:20:54.493 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,9a217c68d2ead807,76a54274e36e17b3] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=9a217c68d2ead807, duration=20 ms] 2024-12-31 18:20:54.493 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:54.494 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241228 2024-12-31 18:20:54.495 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:54.495 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:20:54.496 WARN 34018 --- [ocp-async-6,a926984005c0d63f,7fe57bac031d4b83] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:54.496 INFO 34018 --- [ocp-async-2,677eae3b22e95a79,3e638afbe272ce6c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:54.568 INFO 34018 --- [prometheus-minute-schedule-1,5b2aa76e379e78ec,2c44c78fea91442d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:54.712 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:54.713 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:54.759 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:54.760 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241229 2024-12-31 18:20:54.760 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:54.761 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:20:54.854 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:54.856 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:55.099 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:55.100 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:55.142 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:55.143 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241230 2024-12-31 18:20:55.144 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:55.144 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:20:55.359 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:55.361 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:55.400 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:55.402 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20241231 2024-12-31 18:20:55.402 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:55.403 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:20:55.607 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:55.609 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:55.651 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:55.652 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20250101 2024-12-31 18:20:55.653 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:55.654 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:20:55.921 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:55.923 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:55.955 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:55.956 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20250102 2024-12-31 18:20:55.957 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:55.958 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:20:56.162 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:56.164 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:56.210 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:56.211 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20250103 2024-12-31 18:20:56.212 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:56.213 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:20:56.422 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:56.424 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:56.465 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:56.467 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20250104 2024-12-31 18:20:56.467 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:56.468 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:20:56.496 WARN 34018 --- [ocp-async-10,992f68f5ed615786,0958c207ccdbe5d4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:56.497 INFO 34018 --- [ocp-async-4,d5431b9b7a44b8fd,43b2bb2856337387] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:56.683 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:56.685 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:56.725 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:56.726 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20250105 2024-12-31 18:20:56.727 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:56.728 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:20:56.960 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:56.962 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:57.004 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:57.006 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20250106 2024-12-31 18:20:57.006 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:57.007 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:20:57.157 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,f07f3667f64e92b0,8823616591c67765] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=f07f3667f64e92b0, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:20:57.157 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,2fc81a2d0f950cf7,5c2d625179a817bb] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=2fc81a2d0f950cf7, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:20:57.157 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,1844b1a42d021bb9,31c28a7b5f899d94] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=1844b1a42d021bb9, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:20:57.157 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,cf620cbfe9325b94,ac3382aaf2be499e] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=cf620cbfe9325b94, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:20:57.158 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,1844b1a42d021bb9,31c28a7b5f899d94] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=1844b1a42d021bb9, duration=9 ms] 2024-12-31 18:20:57.158 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,f07f3667f64e92b0,8823616591c67765] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=f07f3667f64e92b0, duration=8 ms] 2024-12-31 18:20:57.158 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,cf620cbfe9325b94,ac3382aaf2be499e] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=cf620cbfe9325b94, duration=8 ms] 2024-12-31 18:20:57.162 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,2fc81a2d0f950cf7,5c2d625179a817bb] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=2fc81a2d0f950cf7, duration=14 ms] 2024-12-31 18:20:57.225 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:57.227 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:57.267 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:57.269 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20250107 2024-12-31 18:20:57.269 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:57.270 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:20:57.513 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:57.515 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:57.553 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:57.554 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_dynamic_sql, partition=P20250108 2024-12-31 18:20:57.555 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:57.555 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_dynamic_sql` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:20:57.568 INFO 34018 --- [prometheus-minute-schedule-1,38a8f54cc1098e76,afb05d99b50f2216] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640460, interval=60 2024-12-31 18:20:57.775 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:57.777 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_dynamic_sql' and table_type='BASE TABLE' 2024-12-31 18:20:57.821 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_dynamic_sql 2024-12-31 18:20:57.823 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:57.824 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:20:57.824 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:57.825 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_high_risk_sql 2024-12-31 18:20:57.840 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241216 2024-12-31 18:20:57.841 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:57.841 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241216 values less than (1734393600000000)) 2024-12-31 18:20:57.857 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:20:57.859 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:20:58.052 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:58.053 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:20:58.090 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:20:58.091 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241217 2024-12-31 18:20:58.092 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:58.092 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241217 values less than (1734480000000000)) 2024-12-31 18:20:58.320 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:58.324 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:20:58.365 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:20:58.366 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241218 2024-12-31 18:20:58.367 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:58.367 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241218 values less than (1734566400000000)) 2024-12-31 18:20:58.484 INFO 34018 --- [ocp-async-3,1b5efe735fcf69f6,660ede3ff7db9020] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:20:58.497 WARN 34018 --- [ocp-async-5,0462e9050a7ab151,0f4925c78f6ee388] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:20:58.497 INFO 34018 --- [ocp-async-6,bfd3c718198897da,73f0f78584d6a629] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:20:58.508 INFO 34018 --- [ocp-schedules-30,c09839a585246a9b,408c7e65388ee623] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:20:58.577 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:58.578 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:20:58.591 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:20:58.591070+08:00, lastProcessTime=2024-12-31T18:20:48.878998+08:00 2024-12-31 18:20:58.615 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:20:58.615 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241219 2024-12-31 18:20:58.616 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:58.617 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241219 values less than (1734652800000000)) 2024-12-31 18:20:58.785 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:20:58.591070+08:00 2024-12-31 18:20:58.925 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:58.927 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:20:58.958 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:20:58.959 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241220 2024-12-31 18:20:58.960 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:58.960 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241220 values less than (1734739200000000)) 2024-12-31 18:20:59.100 INFO 34018 --- [ocp-schedules-6,a75747cdeea1e203,7b1b163727db5efe] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:20:59.213 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:59.215 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:20:59.249 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:20:59.250 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241221 2024-12-31 18:20:59.251 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:59.251 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241221 values less than (1734825600000000)) 2024-12-31 18:20:59.475 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:59.477 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:20:59.519 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:20:59.520 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241222 2024-12-31 18:20:59.521 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:59.522 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241222 values less than (1734912000000000)) 2024-12-31 18:20:59.733 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:59.735 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:20:59.773 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:20:59.775 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241223 2024-12-31 18:20:59.775 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:20:59.776 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241223 values less than (1734998400000000)) 2024-12-31 18:21:00.044 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:00.045 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:00.079 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:00.080 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241224 2024-12-31 18:21:00.081 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:00.081 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241224 values less than (1735084800000000)) 2024-12-31 18:21:00.289 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:00.291 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:00.329 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:00.331 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241225 2024-12-31 18:21:00.331 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:00.332 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241225 values less than (1735171200000000)) 2024-12-31 18:21:00.497 WARN 34018 --- [ocp-async-8,6e4b5697bf579916,bbc792db4214f175] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:00.497 INFO 34018 --- [ocp-async-2,3fca319d75afb2bf,a6032a1d5a4f3e15] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:00.545 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:00.547 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:00.568 INFO 34018 --- [prometheus-minute-schedule-1,1f30c536d816f984,6514868bac3a97c0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:00.589 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:00.590 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241226 2024-12-31 18:21:00.590 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:00.591 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:21:00.809 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:00.811 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:00.851 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:00.852 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241227 2024-12-31 18:21:00.853 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:00.854 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:21:00.859 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:00.862 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:01.071 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:01.073 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:01.116 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:01.118 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241228 2024-12-31 18:21:01.118 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:01.119 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:21:01.339 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:01.362 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:01.400 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:01.401 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241229 2024-12-31 18:21:01.402 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:01.403 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:21:01.600 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:01.602 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:01.645 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:01.646 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241230 2024-12-31 18:21:01.647 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:01.648 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:21:01.864 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:01.866 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:01.909 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:01.910 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20241231 2024-12-31 18:21:01.911 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:01.911 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:21:02.132 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:02.134 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:02.175 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:02.176 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20250101 2024-12-31 18:21:02.177 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:02.178 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:21:02.416 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:02.418 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:02.459 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:02.460 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20250102 2024-12-31 18:21:02.461 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:02.461 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:21:02.497 WARN 34018 --- [ocp-async-4,9d5a4d38cba09712,59f63ddc79171320] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:02.497 INFO 34018 --- [ocp-async-7,19d12baccabc8f34,d874b2196365eb13] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:02.685 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:02.687 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:02.728 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:02.729 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20250103 2024-12-31 18:21:02.730 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:02.731 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:21:02.965 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:02.967 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:03.009 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:03.011 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20250104 2024-12-31 18:21:03.011 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:03.012 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:21:03.228 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:03.229 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:03.268 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:03.269 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20250105 2024-12-31 18:21:03.269 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:03.270 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:21:03.503 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:03.504 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:03.543 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:03.545 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20250106 2024-12-31 18:21:03.545 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:03.546 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:21:03.568 INFO 34018 --- [prometheus-minute-schedule-1,ba1c1e1cd77167eb,9b3223c9424cc103] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:03.773 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:03.775 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:03.819 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:03.821 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20250107 2024-12-31 18:21:03.821 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:03.822 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:21:03.862 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:03.864 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:04.064 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:04.066 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:04.108 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:04.109 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_high_risk_sql, partition=P20250108 2024-12-31 18:21:04.110 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:04.110 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_high_risk_sql` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:21:04.346 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:04.348 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_high_risk_sql' and table_type='BASE TABLE' 2024-12-31 18:21:04.387 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_high_risk_sql 2024-12-31 18:21:04.389 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:04.389 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:21:04.390 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:04.390 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:04.429 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20241226 2024-12-31 18:21:04.430 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:04.430 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:21:04.497 WARN 34018 --- [ocp-async-5,eb8e681ce727f1d7,91b9c168738fec90] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:04.498 INFO 34018 --- [ocp-async-3,527602a87d620473,0c7422994343b7c8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:04.726 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:04.727 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:04.766 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:04.767 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20241227 2024-12-31 18:21:04.768 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:04.768 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:21:05.131 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:05.133 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:05.171 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:05.172 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20241228 2024-12-31 18:21:05.172 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:05.173 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:21:05.577 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:05.579 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:05.619 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:05.620 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20241229 2024-12-31 18:21:05.620 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:05.621 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:21:05.994 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:05.996 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:06.030 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:06.032 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20241230 2024-12-31 18:21:06.032 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:06.033 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:21:06.408 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:06.410 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:06.448 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:06.449 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20241231 2024-12-31 18:21:06.450 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:06.450 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:21:06.498 WARN 34018 --- [ocp-async-6,0320cb15d3e35dc9,7029e338bcb9a4bf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:06.498 INFO 34018 --- [ocp-async-8,fe4816296fc212b9,9fe1cf4f581ca89e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:06.568 INFO 34018 --- [prometheus-minute-schedule-1,5d76430016c38d5c,f5243913527159cc] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:06.788 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:06.791 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:06.835 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:06.837 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20250101 2024-12-31 18:21:06.837 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:06.838 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:21:06.865 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:06.867 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:07.230 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:07.232 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:07.273 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:07.274 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20250102 2024-12-31 18:21:07.274 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:07.275 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:21:07.663 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:07.665 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:07.702 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:07.703 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20250103 2024-12-31 18:21:07.704 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:07.705 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:21:07.940 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,85e7132b33304110,768af979baafea79] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=85e7132b33304110, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:21:07.940 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,b4bb16a9784bf659,3efabbdf78a99344] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=b4bb16a9784bf659, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:21:07.940 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,210ad93e3fa06b76,5d46283d4b5de99b] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=210ad93e3fa06b76, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:21:07.940 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,04b83d530c39e8d7,6c5b1b741f4b0d66] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=04b83d530c39e8d7, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:21:07.942 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,04b83d530c39e8d7,6c5b1b741f4b0d66] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=04b83d530c39e8d7, duration=12 ms] 2024-12-31 18:21:07.942 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,85e7132b33304110,768af979baafea79] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=85e7132b33304110, duration=15 ms] 2024-12-31 18:21:07.942 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,210ad93e3fa06b76,5d46283d4b5de99b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=210ad93e3fa06b76, duration=13 ms] 2024-12-31 18:21:07.947 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,b4bb16a9784bf659,3efabbdf78a99344] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=b4bb16a9784bf659, duration=21 ms] 2024-12-31 18:21:08.040 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:08.042 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:08.081 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:08.082 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20250104 2024-12-31 18:21:08.083 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:08.083 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:21:08.427 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:08.429 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:08.469 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:08.470 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20250105 2024-12-31 18:21:08.470 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:08.471 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:21:08.484 INFO 34018 --- [ocp-async-2,8cb429192fc458e8,30d81092cbd06a42] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:21:08.498 WARN 34018 --- [ocp-async-4,3d38334670b391df,aac58a6f3e7c945c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:08.498 INFO 34018 --- [ocp-async-4,99b1c1d01a9d0963,88666681c6d2cbe4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:08.508 INFO 34018 --- [ocp-schedules-29,6388b43c5b12d252,d611b63e5bce8fec] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:21:08.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:21:08.589892+08:00, lastProcessTime=2024-12-31T18:20:58.591070+08:00 2024-12-31 18:21:08.776 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:21:08.589892+08:00 2024-12-31 18:21:08.777 INFO 34018 --- [ocp-schedules-12,3c52bac18139c1b3,c0e0995a5706d55a] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:21:08.856 INFO 34018 --- [ocp-schedules-12,3c52bac18139c1b3,c0e0995a5706d55a] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:21:08.856 INFO 34018 --- [ocp-schedules-12,3c52bac18139c1b3,c0e0995a5706d55a] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:21:08.964 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:08.966 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:09.003 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:09.004 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20250106 2024-12-31 18:21:09.004 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:09.005 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:21:09.160 INFO 34018 --- [ocp-schedules-14,4aee1ffbaae847d3,627218242417e05e] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:21:09.379 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:09.381 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:09.416 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:09.417 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20250107 2024-12-31 18:21:09.417 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:09.418 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:21:09.568 INFO 34018 --- [prometheus-minute-schedule-1,e443d4e6d254c7d6,24205848e1ef3d41] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:09.765 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:09.767 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:09.806 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:09.807 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_stat_0, partition=P20250108 2024-12-31 18:21:09.807 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:09.808 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_stat_0` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:21:09.867 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:09.869 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:10.003 INFO 34018 --- [ocp-schedules-23,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:21:10.004 INFO 34018 --- [ocp-schedules-10,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:21:10.199 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:10.201 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_stat_0' and table_type='BASE TABLE' 2024-12-31 18:21:10.244 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_stat_0 2024-12-31 18:21:10.246 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:10.247 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:21:10.248 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:10.248 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan 2024-12-31 18:21:10.276 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20241226 2024-12-31 18:21:10.276 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:10.277 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:21:10.498 WARN 34018 --- [ocp-async-5,c4189e90b4ce3116,459c17aba05bc1e3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:10.498 INFO 34018 --- [ocp-async-1,887a53e761bc27a5,610a47e42f132159] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:10.604 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:10.606 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:10.648 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:10.649 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20241227 2024-12-31 18:21:10.650 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:10.650 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:21:10.889 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-12-31 18:21:10.908 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-12-31 18:21:11.072 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:11.074 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:11.118 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:11.119 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20241228 2024-12-31 18:21:11.120 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:11.120 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:21:11.546 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:11.548 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:11.588 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:11.589 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20241229 2024-12-31 18:21:11.590 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:11.590 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:21:12.013 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:12.015 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:12.060 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:12.061 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20241230 2024-12-31 18:21:12.061 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:12.062 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:21:12.476 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:12.477 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:12.498 WARN 34018 --- [ocp-async-10,40e099bb5122cf91,55b8e59d82f18905] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:12.498 INFO 34018 --- [ocp-async-8,f6aa415853098d4d,a29d243bf7d53aae] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:12.520 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:12.521 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20241231 2024-12-31 18:21:12.522 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:12.523 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:21:12.568 INFO 34018 --- [prometheus-minute-schedule-1,d8e74f770916c945,6421b567fa1dce23] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:12.569 INFO 34018 --- [prometheus-hour-schedule-1,75786898f2228c6f,4fb8c4009032c712] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:21:12.869 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:12.871 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:12.934 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:12.936 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:12.979 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:12.980 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20250101 2024-12-31 18:21:12.980 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:12.981 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:21:13.386 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:13.388 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:13.432 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:13.433 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20250102 2024-12-31 18:21:13.433 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:13.434 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:21:13.819 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:13.821 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:13.858 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:13.859 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20250103 2024-12-31 18:21:13.859 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:13.859 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:21:14.267 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:14.269 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:14.313 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:14.314 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20250104 2024-12-31 18:21:14.314 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:14.315 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:21:14.498 WARN 34018 --- [ocp-async-7,d2aa068ea5fbc96c,3c79acd21bb55779] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:14.499 INFO 34018 --- [ocp-async-2,934a66fa1f8fa35d,4e69508f05cbe5a8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:14.730 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:14.732 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:14.776 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:14.777 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20250105 2024-12-31 18:21:14.777 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:14.778 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:21:15.234 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:15.236 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:15.280 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:15.281 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20250106 2024-12-31 18:21:15.281 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:15.282 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:21:15.568 INFO 34018 --- [prometheus-minute-schedule-1,5f629a65c3380787,9c88a16441418a56] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:15.702 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:15.704 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:15.745 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:15.746 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20250107 2024-12-31 18:21:15.747 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:15.747 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:21:15.872 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:15.874 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:16.168 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:16.170 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:16.221 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:16.222 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan, partition=P20250108 2024-12-31 18:21:16.222 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:16.223 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:21:16.499 WARN 34018 --- [ocp-async-3,0fa3c93b423e8f84,a9a6095c6d2e090e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:16.499 INFO 34018 --- [ocp-async-2,794a5554ac426c08,c6bb8aaae38f7bd1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:16.634 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:16.636 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan' and table_type='BASE TABLE' 2024-12-31 18:21:16.670 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan 2024-12-31 18:21:16.672 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:16.672 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:21:16.673 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:16.673 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_explain 2024-12-31 18:21:16.700 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20241226 2024-12-31 18:21:16.701 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:16.701 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:21:17.040 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:17.042 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:17.087 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:17.088 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20241227 2024-12-31 18:21:17.088 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:17.089 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:21:17.557 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:17.558 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:17.593 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:17.594 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20241228 2024-12-31 18:21:17.595 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:17.595 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:21:17.985 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:17.987 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:18.032 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:18.033 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20241229 2024-12-31 18:21:18.034 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:18.034 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:21:18.427 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:18.429 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:18.458 INFO 34018 --- [ocp-schedules-18,c2dbbeb8f8292ed7,34025ba4c0e40db5] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:21:18.458 INFO 34018 --- [ocp-schedules-11,d0da8e42b86ebb0d,b782d50a219bf64d] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:21:18.458 INFO 34018 --- [ocp-schedules-30,173417cac06340a3,1c738090aaa7e9b2] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:21:18.459 INFO 34018 --- [ocp-schedules-20,43548cb5833a5beb,0e339bd31257012b] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:21:18.465 INFO 34018 --- [ocp-schedules-27,5ded90838bedf07e,1bee2a3e46a9ca2a] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:21:18.474 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:18.475 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20241230 2024-12-31 18:21:18.476 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:18.476 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:21:18.484 INFO 34018 --- [ocp-async-2,cf4495b9e8db1533,4f79a0ebf18d41ff] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:21:18.499 WARN 34018 --- [ocp-async-6,28d45801b325eb5c,f457a9d1d5cb3065] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:18.499 INFO 34018 --- [ocp-async-10,a5b725004310ac68,58cffab8dbae51d0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:18.509 INFO 34018 --- [ocp-schedules-14,579cf462223840c5,a74bdbb35b319903] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:21:18.529 INFO 34018 --- [ocp-schedules-1,2a335dff1ea84d6f,fc028d895fbbb958] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:21:18.568 INFO 34018 --- [prometheus-minute-schedule-1,63f2634a0f0ae5ae,87290bc9ce97bdbe] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:18.591 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:21:18.590719+08:00, lastProcessTime=2024-12-31T18:21:08.589892+08:00 2024-12-31 18:21:18.744 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:21:18.590719+08:00 2024-12-31 18:21:18.874 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:18.876 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:18.924 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:18.926 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:18.968 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:18.970 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20241231 2024-12-31 18:21:18.970 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:18.971 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:21:19.208 INFO 34018 --- [ocp-schedules-7,a810cdfa78bed7da,93c93c260bdf0a66] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:21:19.387 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:19.389 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:19.405 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,132c5ef88e094627,fd9b7369c1c5e091] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=132c5ef88e094627, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:21:19.406 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,96db1fcb99a68265,afd7c8456ca1a43b] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=96db1fcb99a68265, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:21:19.407 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,96db1fcb99a68265,afd7c8456ca1a43b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=96db1fcb99a68265, duration=8 ms] 2024-12-31 18:21:19.408 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,9ed715bd75477255,4cc1fab3ef839868] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=9ed715bd75477255, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:21:19.409 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,d861520eda0c5c98,44ef6596c58ba6c9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=d861520eda0c5c98, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:21:19.410 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,d861520eda0c5c98,44ef6596c58ba6c9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=d861520eda0c5c98, duration=7 ms] 2024-12-31 18:21:19.410 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,132c5ef88e094627,fd9b7369c1c5e091] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=132c5ef88e094627, duration=11 ms] 2024-12-31 18:21:19.410 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,9ed715bd75477255,4cc1fab3ef839868] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=9ed715bd75477255, duration=9 ms] 2024-12-31 18:21:19.421 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:19.422 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20250101 2024-12-31 18:21:19.422 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:19.423 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:21:19.796 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:19.798 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:19.836 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:19.837 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20250102 2024-12-31 18:21:19.837 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:19.838 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:21:20.254 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:20.255 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:20.296 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:20.298 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20250103 2024-12-31 18:21:20.298 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:20.299 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:21:20.499 WARN 34018 --- [ocp-async-7,365102d3f6a89974,6a4db01fa3b5fafa] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:20.499 INFO 34018 --- [ocp-async-10,c532f3449ed8aaef,9bf58a8c48d90e46] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:20.742 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:20.743 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:20.780 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:20.781 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20250104 2024-12-31 18:21:20.781 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:20.782 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:21:21.209 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:21.211 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:21.257 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:21.259 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20250105 2024-12-31 18:21:21.259 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:21.260 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:21:21.568 INFO 34018 --- [prometheus-minute-schedule-1,faa77b95bf8cdecc,04bec2d867b40c7a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:21.677 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:21.679 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:21.723 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:21.724 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20250106 2024-12-31 18:21:21.725 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:21.725 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:21:21.876 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:21.878 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:22.128 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:22.130 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:22.173 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:22.174 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20250107 2024-12-31 18:21:22.174 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:22.175 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:21:22.499 WARN 34018 --- [ocp-async-10,393680b41a7743ad,d7659c47331d2f37] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:22.499 INFO 34018 --- [ocp-async-10,9c032bbb9ab6a19c,6ee6a8213a89bbaa] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:22.565 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:22.567 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:22.609 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:22.610 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_plan_cache_plan_explain, partition=P20250108 2024-12-31 18:21:22.611 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:22.611 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_plan_cache_plan_explain` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:21:23.011 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:23.013 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_plan_cache_plan_explain' and table_type='BASE TABLE' 2024-12-31 18:21:23.055 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_plan_cache_plan_explain 2024-12-31 18:21:23.057 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:23.057 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:21:23.058 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:23.058 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample 2024-12-31 18:21:23.098 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20241224 2024-12-31 18:21:23.098 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:23.099 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20241224 values less than (1735084800000000)) 2024-12-31 18:21:23.484 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:23.486 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:23.531 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:23.533 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20241225 2024-12-31 18:21:23.533 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:23.534 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20241225 values less than (1735171200000000)) 2024-12-31 18:21:23.992 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:23.994 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:24.037 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:24.038 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20241226 2024-12-31 18:21:24.039 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:24.040 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:21:24.499 WARN 34018 --- [ocp-async-10,c7e795ee02dc171b,571c173f3aa58f4a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:24.500 INFO 34018 --- [ocp-async-2,752db38cb34a2f76,35217c5cc7f6c092] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:24.504 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:24.505 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:24.548 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:24.550 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20241227 2024-12-31 18:21:24.550 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:24.551 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:21:24.568 INFO 34018 --- [prometheus-minute-schedule-1,1810851f9bd204ef,38cd49a76850df0a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:24.878 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:24.880 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:24.997 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:24.999 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:25.039 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:25.040 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20241228 2024-12-31 18:21:25.041 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:25.041 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:21:25.548 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:25.549 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:25.587 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:25.588 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20241229 2024-12-31 18:21:25.589 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:25.590 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:21:26.070 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:26.072 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:26.113 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:26.115 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20241230 2024-12-31 18:21:26.115 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:26.116 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:21:26.500 WARN 34018 --- [ocp-async-4,afedc9ff6b3f9df0,9bab69b77f47d90e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:26.500 INFO 34018 --- [ocp-async-7,ec9bfe9c4cd6a6c3,f748fa7f01eae772] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:26.595 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:26.597 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:26.630 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:26.631 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20241231 2024-12-31 18:21:26.631 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:26.632 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:21:27.201 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:27.203 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:27.249 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:27.250 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20250101 2024-12-31 18:21:27.251 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:27.251 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:21:27.568 INFO 34018 --- [prometheus-minute-schedule-1,10de36aadb7e1614,51c5181fcb1d1dc9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:27.726 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:27.728 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:27.773 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:27.774 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20250102 2024-12-31 18:21:27.775 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:27.776 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:21:27.880 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:27.882 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:28.260 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:28.262 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:28.305 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:28.306 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20250103 2024-12-31 18:21:28.307 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:28.308 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:21:28.485 INFO 34018 --- [ocp-async-7,e81759665c13b110,ad613ba2c0e6f8d6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:21:28.502 WARN 34018 --- [ocp-async-3,5ef9e5c8943e326e,9386120751c67287] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:28.502 INFO 34018 --- [ocp-async-1,a0328bfda1ebefc7,4b599c033047ac52] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:28.509 INFO 34018 --- [ocp-schedules-10,9d58cac9cd31c6d3,d5d1d97183e5b5b9] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:21:28.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:21:28.589745+08:00, lastProcessTime=2024-12-31T18:21:18.590719+08:00 2024-12-31 18:21:28.719 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,a785ea5602b4fdcc,e3f563ef40d496a0] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=a785ea5602b4fdcc, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:21:28.720 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,a785ea5602b4fdcc,e3f563ef40d496a0] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=a785ea5602b4fdcc, duration=7 ms] 2024-12-31 18:21:28.721 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,7d0e01d1d5606caa,7eb3b951561c64de] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=7d0e01d1d5606caa, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:21:28.721 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,beed89bf9efd8f6c,61ce911aec92170b] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=beed89bf9efd8f6c, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:21:28.721 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,1083224efee320b2,b7e1246829d254f9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=1083224efee320b2, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:21:28.722 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,1083224efee320b2,b7e1246829d254f9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=1083224efee320b2, duration=11 ms] 2024-12-31 18:21:28.722 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,beed89bf9efd8f6c,61ce911aec92170b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=beed89bf9efd8f6c, duration=12 ms] 2024-12-31 18:21:28.726 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,7d0e01d1d5606caa,7eb3b951561c64de] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=7d0e01d1d5606caa, duration=18 ms] 2024-12-31 18:21:28.768 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:21:28.589745+08:00 2024-12-31 18:21:28.825 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:28.826 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:28.859 INFO 34018 --- [ocp-schedules-25,a0196d7881f79abc,a78ea9dff89cefaa] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:21:28.863 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:28.864 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20250104 2024-12-31 18:21:28.865 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:28.865 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:21:28.868 INFO 34018 --- [ocp-schedules-25,a0196d7881f79abc,a78ea9dff89cefaa] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:21:28.868 INFO 34018 --- [ocp-schedules-25,a0196d7881f79abc,a78ea9dff89cefaa] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:21:29.260 INFO 34018 --- [ocp-schedules-28,ecbc978c65836958,d24ae848b6da4987] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:21:29.324 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:29.326 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:29.357 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:29.358 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20250105 2024-12-31 18:21:29.358 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:29.359 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:21:29.815 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:29.816 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:29.854 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:29.855 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20250106 2024-12-31 18:21:29.856 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:29.856 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:21:30.326 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:30.328 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:30.371 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:30.372 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20250107 2024-12-31 18:21:30.373 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:30.374 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:21:30.502 WARN 34018 --- [ocp-async-8,820b77a2fc6e506f,1c16d99cb93008ec] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:30.502 INFO 34018 --- [ocp-async-10,aa80af682a08acb5,cdb5195286eccb6b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:30.568 INFO 34018 --- [prometheus-minute-schedule-1,70395910f5c978d6,7751c725fdd86101] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:30.864 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:30.866 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:30.882 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:30.884 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:30.905 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:30.906 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample, partition=P20250108 2024-12-31 18:21:30.907 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:30.908 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:21:31.345 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:31.347 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample' and table_type='BASE TABLE' 2024-12-31 18:21:31.384 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample 2024-12-31 18:21:31.386 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:31.386 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:21:31.387 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:31.387 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:31.419 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20241224 2024-12-31 18:21:31.419 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:31.420 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20241224 values less than (1735084800000000)) 2024-12-31 18:21:31.671 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:31.672 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:31.708 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:31.709 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20241225 2024-12-31 18:21:31.709 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:31.710 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20241225 values less than (1735171200000000)) 2024-12-31 18:21:31.986 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:31.988 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:32.024 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:32.024 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20241226 2024-12-31 18:21:32.025 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:32.026 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:21:32.300 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:32.302 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:32.352 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:32.353 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20241227 2024-12-31 18:21:32.354 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:32.355 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:21:32.502 WARN 34018 --- [ocp-async-2,0b05606a2941d700,a097eab5087786a9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:32.503 INFO 34018 --- [ocp-async-9,e42fdda0643591ab,ad45ee7ba9a80554] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:32.639 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:32.641 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:32.676 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:32.677 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20241228 2024-12-31 18:21:32.677 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:32.678 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:21:32.959 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:32.961 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:32.998 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:32.999 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20241229 2024-12-31 18:21:32.999 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:33.000 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:21:33.261 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:33.263 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:33.297 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:33.298 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20241230 2024-12-31 18:21:33.298 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:33.299 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:21:33.568 INFO 34018 --- [prometheus-minute-schedule-1,71a238fccf31f029,fd850cd63c2c43fd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:33.595 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:33.596 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:33.634 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:33.635 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20241231 2024-12-31 18:21:33.635 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:33.636 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:21:33.884 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:33.886 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:33.924 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:33.926 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:33.967 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:33.969 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20250101 2024-12-31 18:21:33.969 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:33.970 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:21:34.264 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:34.265 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:34.298 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:34.299 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20250102 2024-12-31 18:21:34.299 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:34.300 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:21:34.503 WARN 34018 --- [ocp-async-5,e375ab9a88389bee,3ca92d69bc6f28c1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:34.503 INFO 34018 --- [ocp-async-7,17d8abc006347aab,ba80481ade297c23] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:34.570 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:34.572 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:34.609 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:34.610 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20250103 2024-12-31 18:21:34.610 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:34.611 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:21:34.924 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:34.926 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:34.964 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:34.965 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20250104 2024-12-31 18:21:34.966 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:34.967 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:21:35.267 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:35.269 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:35.306 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:35.307 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20250105 2024-12-31 18:21:35.308 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:35.308 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:21:35.627 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:35.629 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:35.670 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:35.671 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20250106 2024-12-31 18:21:35.671 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:35.672 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:21:35.990 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:35.992 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:36.032 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:36.033 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20250107 2024-12-31 18:21:36.034 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:36.035 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:21:36.349 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:36.351 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:36.391 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:36.392 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_audit_sample_statistics, partition=P20250108 2024-12-31 18:21:36.393 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:36.394 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_audit_sample_statistics` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:21:36.503 WARN 34018 --- [ocp-async-7,9b2b028412d9f95f,c038139a7c238573] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:36.503 INFO 34018 --- [ocp-async-3,111c916c443b2244,f86409b6b16fdd63] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:36.568 INFO 34018 --- [prometheus-minute-schedule-1,53f752bb46bb1e35,0bc89a5316cfd32f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:36.569 INFO 34018 --- [prometheus-cache-monitor1,677bfe5bbf7932d5,148ddcf50547c4b0] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":0,"seriesIdKeySize":0,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2024-12-31 18:21:36.569 INFO 34018 --- [prometheus-cache-monitor1,677bfe5bbf7932d5,148ddcf50547c4b0] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{} 2024-12-31 18:21:36.701 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:36.703 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_audit_sample_statistics' and table_type='BASE TABLE' 2024-12-31 18:21:36.746 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_audit_sample_statistics 2024-12-31 18:21:36.748 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:36.748 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:21:36.750 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:36.750 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis_task 2024-12-31 18:21:36.762 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241201 2024-12-31 18:21:36.763 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:36.764 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241201 values less than (1733097600000000)) 2024-12-31 18:21:36.887 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:36.888 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:36.967 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:36.968 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:37.003 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:37.004 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241202 2024-12-31 18:21:37.004 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:37.004 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241202 values less than (1733184000000000)) 2024-12-31 18:21:38.033 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1029, sql=alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241202 values less than (1733184000000000)) 2024-12-31 18:21:38.034 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:38.035 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:38.071 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:38.072 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241203 2024-12-31 18:21:38.073 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:38.073 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241203 values less than (1733270400000000)) 2024-12-31 18:21:38.331 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:38.333 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:38.374 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:38.376 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241204 2024-12-31 18:21:38.376 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:38.377 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241204 values less than (1733356800000000)) 2024-12-31 18:21:38.485 INFO 34018 --- [ocp-async-10,9ad1e06d3e191a7c,62a4fb53fa50d895] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:21:38.503 INFO 34018 --- [ocp-async-2,de110f4e75f3ab44,9cee0bad8587057c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:38.503 WARN 34018 --- [ocp-async-4,60a082551907d4ca,30d907437ac7708b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:38.509 INFO 34018 --- [ocp-schedules-7,a35b1b822e8d1e80,9b908cc7a1612a27] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:21:38.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:21:38.589232+08:00, lastProcessTime=2024-12-31T18:21:28.589745+08:00 2024-12-31 18:21:38.636 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:38.637 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:38.681 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:38.682 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241205 2024-12-31 18:21:38.682 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:38.683 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241205 values less than (1733443200000000)) 2024-12-31 18:21:38.763 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:21:38.589232+08:00 2024-12-31 18:21:38.956 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:38.958 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:38.994 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:38.995 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241206 2024-12-31 18:21:38.995 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:38.996 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241206 values less than (1733529600000000)) 2024-12-31 18:21:39.305 INFO 34018 --- [ocp-schedules-25,4979ed6bc0cea3e8,38419e8ea72b7436] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:21:39.568 INFO 34018 --- [prometheus-minute-schedule-1,3bf2d06aea3b0309,700a866d35566acc] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:39.777 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:39.778 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:39.813 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:39.814 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241207 2024-12-31 18:21:39.814 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:39.815 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241207 values less than (1733616000000000)) 2024-12-31 18:21:39.888 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:39.890 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:40.003 INFO 34018 --- [ocp-schedules-17,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:21:40.004 INFO 34018 --- [ocp-schedules-21,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:21:40.503 WARN 34018 --- [ocp-async-1,a5ee0ecc444b2b79,c627b5b251b13656] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:40.503 INFO 34018 --- [ocp-async-2,cf7c3a7836373dc9,c6a40da1384e1f9d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:41.249 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=1434, sql=alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241207 values less than (1733616000000000)) 2024-12-31 18:21:41.249 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:41.251 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:41.294 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:41.295 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241208 2024-12-31 18:21:41.296 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:41.296 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241208 values less than (1733702400000000)) 2024-12-31 18:21:41.577 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:41.579 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:41.615 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:41.616 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241209 2024-12-31 18:21:41.616 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:41.617 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241209 values less than (1733788800000000)) 2024-12-31 18:21:41.887 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:41.888 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:41.925 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:41.926 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241210 2024-12-31 18:21:41.927 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:41.927 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241210 values less than (1733875200000000)) 2024-12-31 18:21:42.205 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:42.207 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:42.257 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:42.258 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241211 2024-12-31 18:21:42.259 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:42.260 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241211 values less than (1733961600000000)) 2024-12-31 18:21:42.503 WARN 34018 --- [ocp-async-3,bb3ccc35d9d7296a,9dbe7c9638fe36c5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:42.504 INFO 34018 --- [ocp-async-2,4fbac5b38e976196,ef1f50f605126267] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:42.568 INFO 34018 --- [prometheus-minute-schedule-1,6bd1dde6225a2827,7c426ffd0e2ca2f7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:42.890 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:42.892 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:44.504 WARN 34018 --- [ocp-async-7,dad414bd4144d9e7,cd94e26ad1756806] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:44.504 INFO 34018 --- [ocp-async-1,5565c0b60c21fcaa,cbce1ba0321de8a2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:44.514 WARN 34018 --- [ocp-async-1,5565c0b60c21fcaa,cbce1ba0321de8a2] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-12-31 18:21:45.235 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] slow query, durationMillis=2976, sql=alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241211 values less than (1733961600000000)) 2024-12-31 18:21:45.236 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:45.238 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:45.282 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:45.283 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241212 2024-12-31 18:21:45.284 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:45.285 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241212 values less than (1734048000000000)) 2024-12-31 18:21:45.562 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:45.563 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:45.568 INFO 34018 --- [prometheus-minute-schedule-1,efd9bb34606006db,9cbd70ae50ab2073] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:45.599 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:45.600 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241213 2024-12-31 18:21:45.600 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:45.601 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241213 values less than (1734134400000000)) 2024-12-31 18:21:45.876 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:45.878 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:45.892 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:45.894 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:45.918 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:45.919 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241214 2024-12-31 18:21:45.920 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:45.920 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241214 values less than (1734220800000000)) 2024-12-31 18:21:46.216 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:46.217 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:46.256 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:46.257 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241215 2024-12-31 18:21:46.257 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:46.258 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241215 values less than (1734307200000000)) 2024-12-31 18:21:46.504 WARN 34018 --- [ocp-async-7,f47c28962bad3a28,91a268604178895f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:46.504 INFO 34018 --- [ocp-async-9,d76124d472784841,2c1cf20f438077c7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:46.542 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:46.544 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:46.581 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:46.582 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241216 2024-12-31 18:21:46.583 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:46.583 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241216 values less than (1734393600000000)) 2024-12-31 18:21:46.857 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:46.859 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:46.896 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:46.897 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241217 2024-12-31 18:21:46.897 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:46.898 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241217 values less than (1734480000000000)) 2024-12-31 18:21:47.175 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:47.176 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:47.214 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:47.214 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241218 2024-12-31 18:21:47.215 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:47.216 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241218 values less than (1734566400000000)) 2024-12-31 18:21:47.495 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:47.497 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:47.542 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:47.543 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241219 2024-12-31 18:21:47.543 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:47.544 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241219 values less than (1734652800000000)) 2024-12-31 18:21:47.830 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:47.832 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:47.878 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:47.879 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241220 2024-12-31 18:21:47.879 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:47.880 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241220 values less than (1734739200000000)) 2024-12-31 18:21:48.167 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:48.168 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:48.212 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:48.213 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241221 2024-12-31 18:21:48.214 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:48.215 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241221 values less than (1734825600000000)) 2024-12-31 18:21:48.456 INFO 34018 --- [ocp-schedules-19,86692e8a4903a49a,ce06b5c133e39e91] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:21:48.457 INFO 34018 --- [ocp-schedules-30,ecda5fc4005e3b4c,aa5ed1a42ac10e79] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:21:48.458 INFO 34018 --- [ocp-schedules-18,740f9c43942a9f80,db2afd8a882088e6] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:21:48.458 INFO 34018 --- [ocp-schedules-24,8ccf1dfa7e587c5c,912b950df0009e19] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:21:48.458 INFO 34018 --- [ocp-schedules-4,43788fbf0891671c,1fd07add692db932] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:21:48.458 INFO 34018 --- [ocp-schedules-23,a19ceeba9dc84623,3c664a45ffbdc2b9] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:21:48.464 INFO 34018 --- [ocp-schedules-26,693f780b6e196fce,c8d5195c05c6fd7f] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:21:48.464 INFO 34018 --- [ocp-schedules-19,86692e8a4903a49a,ce06b5c133e39e91] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:21:48.468 INFO 34018 --- [ocp-schedules-4,43788fbf0891671c,1fd07add692db932] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:21:48.473 INFO 34018 --- [ocp-schedules-28,2e3e3fa5209b2c21,54aa06bd44662f06] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: hostQueryCache 2024-12-31 18:21:48.473 INFO 34018 --- [ocp-schedules-28,2e3e3fa5209b2c21,54aa06bd44662f06] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2024-12-31 18:21:48.485 INFO 34018 --- [ocp-schedules-28,2e3e3fa5209b2c21,54aa06bd44662f06] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2024-12-31 18:21:48.485 INFO 34018 --- [ocp-schedules-28,2e3e3fa5209b2c21,54aa06bd44662f06] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obQueryCache 2024-12-31 18:21:48.485 INFO 34018 --- [ocp-schedules-28,2e3e3fa5209b2c21,54aa06bd44662f06] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2024-12-31 18:21:48.485 INFO 34018 --- [ocp-schedules-20,f73a28dd37565de9,aef71d1252f28d68] c.o.o.s.common.scheduled.PerfSchedules : Collect high risk sql audit stat, time=2024-12-31T18:21:48.485+08:00, tenantSize=0 2024-12-31 18:21:48.485 INFO 34018 --- [ocp-async-3,7bfd53f13f196771,c4a2bf670bc35242] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:21:48.493 INFO 34018 --- [ocp-schedules-7,c15007a1136087a6,e3d84cc69f9a3799] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[] 2024-12-31 18:21:48.493 INFO 34018 --- [ocp-schedules-28,2e3e3fa5209b2c21,54aa06bd44662f06] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2024-12-31 18:21:48.493 INFO 34018 --- [ocp-schedules-28,2e3e3fa5209b2c21,54aa06bd44662f06] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obProxyQueryCache 2024-12-31 18:21:48.493 INFO 34018 --- [ocp-schedules-28,2e3e3fa5209b2c21,54aa06bd44662f06] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2024-12-31 18:21:48.493 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:48.494 INFO 34018 --- [ocp-schedules-7,c15007a1136087a6,e3d84cc69f9a3799] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2024-12-31 18:21:48.495 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:48.498 INFO 34018 --- [ocp-schedules-28,2e3e3fa5209b2c21,54aa06bd44662f06] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2024-12-31 18:21:48.501 INFO 34018 --- [ocp-schedules-27,24b39909e5b3589a,b7b3cdbdcdacf4fe] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2024-12-31 18:21:48.504 WARN 34018 --- [ocp-async-8,0a665d5a40350c02,99e48858c195dbf3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:48.504 INFO 34018 --- [ocp-async-2,524bceec2336097e,2e3230ff2faada56] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:48.509 INFO 34018 --- [ocp-schedules-30,749fb46205c7a2e7,8f6c3a186b3d9d5a] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:21:48.513 INFO 34018 --- [ocp-schedules-26,79299dd18d8737e0,230e5e195965b0de] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:21:48.514 INFO 34018 --- [ocp-schedules-25,f8967d2c16119960,dd8afbd7fb7bbc3b] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:21:48.514 INFO 34018 --- [ocp-schedules-4,5f29bd2b13c6946c,9ad43e08a654649c] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:21:48.514 INFO 34018 --- [ocp-schedules-11,e4ad65a83f9edc49,a88d5e0fcb056128] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:21:48.514 INFO 34018 --- [ocp-schedules-10,aaf49b36536276f3,898803c4e12f6849] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":0,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":349,"seriesIdKeySize":349,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2024-12-31 18:21:48.515 INFO 34018 --- [ocp-schedules-10,aaf49b36536276f3,898803c4e12f6849] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=33, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=33, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:21:48.515 INFO 34018 --- [ocp-schedules-25,f8967d2c16119960,dd8afbd7fb7bbc3b] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:21:48.515 INFO 34018 --- [ocp-schedules-11,e4ad65a83f9edc49,a88d5e0fcb056128] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:21:48.516 INFO 34018 --- [ocp-schedules-6,339169c9e7ecddc7,139e8899ec64af60] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:21:48.517 INFO 34018 --- [ocp-schedules-6,339169c9e7ecddc7,139e8899ec64af60] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:21:48.525 INFO 34018 --- [ocp-schedules-16,1c063b2198ed7106,ce96382dea7acae7] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:21:48.525+08:00, clusters=[] 2024-12-31 18:21:48.526 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:48.527 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241222 2024-12-31 18:21:48.527 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:48.528 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241222 values less than (1734912000000000)) 2024-12-31 18:21:48.529 INFO 34018 --- [ocp-schedules-15,6e94cd48962481d0,8f16516310cfd1b8] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:21:48.529 INFO 34018 --- [ocp-schedules-20,d323fa3595d0c7b5,8fed76072a22546f] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:21:48.529+08:00, clusters=[] 2024-12-31 18:21:48.529 INFO 34018 --- [ocp-schedules-19,686a657dc8648c12,8b21f7f907f1ea04] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:21:48.529 INFO 34018 --- [ocp-schedules-19,686a657dc8648c12,8b21f7f907f1ea04] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:21:48.531 INFO 34018 --- [ocp-schedules-13,2a79aa55e78349da,c2537fb72090cfa0] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:21:48.531 INFO 34018 --- [ocp-schedules-19,686a657dc8648c12,8b21f7f907f1ea04] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:21:48.531 INFO 34018 --- [ocp-schedules-19,686a657dc8648c12,8b21f7f907f1ea04] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:21:48.532 INFO 34018 --- [ocp-schedules-3,4ea18c5e36909c87,fd8b7cdc3e04997b] c.o.o.s.common.scheduled.HostSchedules : Refresh all agent config, hostIps=[] 2024-12-31 18:21:48.533 INFO 34018 --- [ocp-schedules-3,4ea18c5e36909c87,fd8b7cdc3e04997b] c.o.o.s.common.scheduled.HostSchedules : Refresh all agent config finished 2024-12-31 18:21:48.533 INFO 34018 --- [ocp-schedules-14,ea38d99577267232,ecc53e61de28183c] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:21:48.533 INFO 34018 --- [ocp-schedules-14,ea38d99577267232,ecc53e61de28183c] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:21:48.533 INFO 34018 --- [ocp-schedules-17,dfed4db7814c5413,be95aa700e3eee2a] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:21:48.553 INFO 34018 --- [ocp-schedules-7,8192f435501f6d04,884f811307866bd8] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:21:48.557 INFO 34018 --- [ocp-schedules-7,8192f435501f6d04,884f811307866bd8] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:21:48.557 INFO 34018 --- [ocp-schedules-7,8192f435501f6d04,884f811307866bd8] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 0 2024-12-31 18:21:48.568 INFO 34018 --- [prometheus-minute-schedule-1,0898488b906b76cc,99c8615522a27ec3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:48.580 INFO 34018 --- [ocp-schedules-22,d7cbc05c9541c6b7,b2c3de7e3b8879df] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:21:48.580 INFO 34018 --- [ocp-schedules-22,d7cbc05c9541c6b7,b2c3de7e3b8879df] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:21:48.581 INFO 34018 --- [ocp-schedules-22,d7cbc05c9541c6b7,b2c3de7e3b8879df] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:21:48.581 INFO 34018 --- [ocp-schedules-22,d7cbc05c9541c6b7,b2c3de7e3b8879df] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:21:48.582 INFO 34018 --- [ocp-schedules-22,d7cbc05c9541c6b7,b2c3de7e3b8879df] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:21:48.582 INFO 34018 --- [ocp-schedules-22,d7cbc05c9541c6b7,b2c3de7e3b8879df] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:21:48.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:21:48.588451+08:00, lastProcessTime=2024-12-31T18:21:38.589232+08:00 2024-12-31 18:21:48.606 INFO 34018 --- [ocp-schedules-22,d7cbc05c9541c6b7,b2c3de7e3b8879df] c.o.ocp.monitor.service.IdKeyService : Sync record key and id, newRecordIdsCount=349, maxSyncedRecordId=730651867074035712 2024-12-31 18:21:48.736 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:21:48.588451+08:00 2024-12-31 18:21:48.777 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:48.778 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:48.809 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:48.809 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241223 2024-12-31 18:21:48.810 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:48.810 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241223 values less than (1734998400000000)) 2024-12-31 18:21:48.870 INFO 34018 --- [ocp-schedules-24,6978dfd76efd921f,a623caebe554ea19] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:21:48.878 INFO 34018 --- [ocp-schedules-24,6978dfd76efd921f,a623caebe554ea19] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:21:48.878 INFO 34018 --- [ocp-schedules-24,6978dfd76efd921f,a623caebe554ea19] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:21:48.894 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:48.896 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:49.063 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:49.065 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:49.102 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:49.104 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241224 2024-12-31 18:21:49.104 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:49.105 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241224 values less than (1735084800000000)) 2024-12-31 18:21:49.351 INFO 34018 --- [ocp-schedules-25,3ded25660223e670,982781afbd9fb778] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:21:49.400 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:49.402 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:49.443 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:49.444 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241225 2024-12-31 18:21:49.445 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:49.445 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241225 values less than (1735171200000000)) 2024-12-31 18:21:49.703 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:49.705 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:49.742 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:49.743 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241226 2024-12-31 18:21:49.743 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:49.744 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:21:50.025 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:50.026 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:50.061 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:50.062 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241227 2024-12-31 18:21:50.062 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:50.063 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:21:50.331 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:50.333 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:50.378 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:50.379 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241228 2024-12-31 18:21:50.380 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:50.381 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:21:50.504 WARN 34018 --- [ocp-async-5,516347515d4926ba,375557c6cc1c856e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:50.504 INFO 34018 --- [ocp-async-7,d571b60ee1c7fc12,9732ca4a67ec6d00] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:50.661 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:50.663 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:50.705 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:50.707 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241229 2024-12-31 18:21:50.707 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:50.708 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:21:51.085 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:51.087 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:51.129 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:51.130 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241230 2024-12-31 18:21:51.130 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:51.131 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:21:51.409 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:51.410 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:51.452 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:51.453 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20241231 2024-12-31 18:21:51.453 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:51.454 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:21:51.568 INFO 34018 --- [prometheus-minute-schedule-1,262e8b7fce5ed825,dfe6f5126494eab0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:51.745 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:51.748 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:51.789 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:51.790 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20250101 2024-12-31 18:21:51.791 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:51.791 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:21:51.889 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:21:51.896 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:51.898 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:21:52.079 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:52.081 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:52.123 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:52.124 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20250102 2024-12-31 18:21:52.125 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:52.125 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:21:52.398 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:52.400 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:52.443 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:52.444 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20250103 2024-12-31 18:21:52.445 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:52.446 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:21:52.505 WARN 34018 --- [ocp-async-7,b8dac642d24b7851,5ce103a778baae08] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:52.505 INFO 34018 --- [ocp-async-6,fcfda3e5a528d207,5b7c3265ce2c466b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:52.729 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:52.731 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:52.779 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:52.781 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20250104 2024-12-31 18:21:52.781 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:52.782 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:21:53.063 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:53.065 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:53.109 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:53.110 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20250105 2024-12-31 18:21:53.111 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:53.111 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:21:53.397 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:53.399 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:53.439 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:53.440 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20250106 2024-12-31 18:21:53.440 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:53.441 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:21:53.723 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:53.725 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:53.766 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:53.767 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20250107 2024-12-31 18:21:53.767 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:53.768 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:21:54.047 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:54.049 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:54.090 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:54.091 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis_task, partition=P20250108 2024-12-31 18:21:54.092 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:54.093 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis_task` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:21:54.369 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:54.370 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis_task' and table_type='BASE TABLE' 2024-12-31 18:21:54.404 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis_task 2024-12-31 18:21:54.405 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:54.405 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:21:54.406 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:54.406 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis 2024-12-31 18:21:54.425 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241201 2024-12-31 18:21:54.425 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:54.425 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241201 values less than (1733097600000000)) 2024-12-31 18:21:54.505 WARN 34018 --- [ocp-async-10,267e47966a87f313,11c82dec8de436e2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:54.505 INFO 34018 --- [ocp-async-8,cf8d20bb004f03cd,29a1cf05e62f1158] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:54.568 INFO 34018 --- [prometheus-minute-schedule-1,d2e14e697ce438ea,306bd27a60ffade9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:54.713 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:54.715 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:21:54.755 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:21:54.756 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241202 2024-12-31 18:21:54.756 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:54.757 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241202 values less than (1733184000000000)) 2024-12-31 18:21:54.899 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:54.901 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:55.134 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:55.136 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:21:55.175 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:21:55.176 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241203 2024-12-31 18:21:55.176 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:55.177 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241203 values less than (1733270400000000)) 2024-12-31 18:21:55.527 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:55.528 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:21:55.569 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:21:55.570 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241204 2024-12-31 18:21:55.571 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:55.571 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241204 values less than (1733356800000000)) 2024-12-31 18:21:55.918 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:55.920 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:21:55.962 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:21:55.963 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241205 2024-12-31 18:21:55.963 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:55.964 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241205 values less than (1733443200000000)) 2024-12-31 18:21:56.348 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:56.350 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:21:56.389 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:21:56.390 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241206 2024-12-31 18:21:56.391 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:56.391 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241206 values less than (1733529600000000)) 2024-12-31 18:21:56.505 WARN 34018 --- [ocp-async-1,5de869e78968d162,1fba39bb53540986] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:56.505 INFO 34018 --- [ocp-async-8,5e11fe619e89d39d,31c0c077cd5afd4e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:56.744 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:56.746 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:21:56.787 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:21:56.788 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241207 2024-12-31 18:21:56.789 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:56.789 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241207 values less than (1733616000000000)) 2024-12-31 18:21:57.155 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:57.156 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:21:57.195 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:21:57.196 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241208 2024-12-31 18:21:57.197 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:57.197 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241208 values less than (1733702400000000)) 2024-12-31 18:21:57.545 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:57.547 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:21:57.568 INFO 34018 --- [prometheus-minute-schedule-1,8dd0881522ac99fb,2d505bc35b3cb3f2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640520, interval=60 2024-12-31 18:21:57.588 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:21:57.589 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241209 2024-12-31 18:21:57.590 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:57.590 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241209 values less than (1733788800000000)) 2024-12-31 18:21:57.901 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:21:57.903 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:21:57.946 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:57.947 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:21:57.986 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:21:57.987 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241210 2024-12-31 18:21:57.988 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:57.988 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241210 values less than (1733875200000000)) 2024-12-31 18:21:58.351 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:58.353 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:21:58.399 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:21:58.401 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241211 2024-12-31 18:21:58.401 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:58.402 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241211 values less than (1733961600000000)) 2024-12-31 18:21:58.482 WARN 34018 --- [ocp-schedules-8,a186e622d3380da9,908c0c7a1e25447a] c.o.o.c.d.lock.jdbc.DefaultLockManager : LockException while executing with jdbc lock part-worker Cannot acquire lock for key part-worker 2024-12-31 18:21:58.483 ERROR 34018 --- [ocp-schedules-8,a186e622d3380da9,908c0c7a1e25447a] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task java.lang.RuntimeException: java.lang.reflect.InvocationTargetException at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:79) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) ... 10 common frames omitted Caused by: com.oceanbase.ocp.core.distributed.lock.LockException: Cannot acquire lock for key part-worker at com.oceanbase.ocp.core.distributed.lock.jdbc.DefaultLockManager.doExecuteWhileLocked(DefaultLockManager.java:97) at com.oceanbase.ocp.core.distributed.lock.jdbc.DefaultLockManager.executeWhileLocked(DefaultLockManager.java:81) at com.oceanbase.ocp.service.partitioning.PartitionRolloverService.watchAllWhileLocked(PartitionRolloverService.java:121) at com.oceanbase.ocp.server.common.scheduled.OcpSchedules.partitionDaemon(OcpSchedules.java:130) ... 15 common frames omitted 2024-12-31 18:21:58.485 INFO 34018 --- [ocp-async-4,25351256ca653a99,af7bc45e7529e324] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:21:58.505 WARN 34018 --- [ocp-async-10,908122064971120c,dd87f67a1608adc4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:21:58.505 INFO 34018 --- [ocp-async-9,4375198ee8474501,633594fe977963cc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:21:58.510 INFO 34018 --- [ocp-schedules-26,aacc6396e32b1a2f,74b5d3b4025cf94f] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:21:58.591 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:21:58.590744+08:00, lastProcessTime=2024-12-31T18:21:48.588451+08:00 2024-12-31 18:21:58.761 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:58.763 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:21:58.768 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:21:58.590744+08:00 2024-12-31 18:21:58.796 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:21:58.797 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241212 2024-12-31 18:21:58.798 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:58.798 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241212 values less than (1734048000000000)) 2024-12-31 18:21:59.325 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:59.327 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:21:59.374 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:21:59.375 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241213 2024-12-31 18:21:59.376 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:59.376 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241213 values less than (1734134400000000)) 2024-12-31 18:21:59.447 INFO 34018 --- [ocp-schedules-9,6a4572d86464c496,cd663a4de848330f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:21:59.730 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:59.731 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:21:59.765 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:21:59.766 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241214 2024-12-31 18:21:59.767 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:21:59.768 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241214 values less than (1734220800000000)) 2024-12-31 18:22:00.145 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:00.147 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:00.191 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:00.192 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241215 2024-12-31 18:22:00.192 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:00.193 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241215 values less than (1734307200000000)) 2024-12-31 18:22:00.505 WARN 34018 --- [ocp-async-3,281c94209417b219,831851e18740078b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:00.506 INFO 34018 --- [ocp-async-2,33058d4919adac5b,75e33ee6dee1fc7d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:00.545 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:00.547 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:00.568 INFO 34018 --- [prometheus-minute-schedule-1,92da13afe4fba671,34f2018209ff33c6] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:00.591 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:00.592 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241216 2024-12-31 18:22:00.593 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:00.593 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241216 values less than (1734393600000000)) 2024-12-31 18:22:00.903 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:00.905 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:00.944 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:00.946 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:00.989 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:00.990 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241217 2024-12-31 18:22:00.991 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:00.992 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241217 values less than (1734480000000000)) 2024-12-31 18:22:01.402 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:01.404 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:01.443 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:01.444 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241218 2024-12-31 18:22:01.444 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:01.445 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241218 values less than (1734566400000000)) 2024-12-31 18:22:01.822 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:01.824 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:01.864 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:01.866 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241219 2024-12-31 18:22:01.866 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:01.867 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241219 values less than (1734652800000000)) 2024-12-31 18:22:02.266 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:02.268 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:02.312 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:02.313 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241220 2024-12-31 18:22:02.314 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:02.315 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241220 values less than (1734739200000000)) 2024-12-31 18:22:02.506 WARN 34018 --- [ocp-async-8,c0e389cff29fbd1e,c536659dc59278a9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:02.506 INFO 34018 --- [ocp-async-2,38ff6db64444aaef,800c3dcc6df8497e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:02.692 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:02.694 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:02.730 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:02.731 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241221 2024-12-31 18:22:02.732 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:02.732 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241221 values less than (1734825600000000)) 2024-12-31 18:22:03.128 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:03.130 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:03.171 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:03.172 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241222 2024-12-31 18:22:03.172 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:03.173 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241222 values less than (1734912000000000)) 2024-12-31 18:22:03.538 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:03.539 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:03.568 INFO 34018 --- [prometheus-minute-schedule-1,8deb008ceac89dc7,f344e02e71b46d2b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:03.572 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:03.573 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241223 2024-12-31 18:22:03.573 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:03.574 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241223 values less than (1734998400000000)) 2024-12-31 18:22:03.906 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:03.908 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:03.957 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:03.959 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:04.005 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:04.006 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241224 2024-12-31 18:22:04.007 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:04.008 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241224 values less than (1735084800000000)) 2024-12-31 18:22:04.162 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2024-12-31 18:22:04.166 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=4ms, period=120000ms 2024-12-31 18:22:04.394 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:04.396 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:04.436 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:04.437 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241225 2024-12-31 18:22:04.437 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:04.438 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241225 values less than (1735171200000000)) 2024-12-31 18:22:04.506 WARN 34018 --- [ocp-async-10,a15c09bc10567bf5,675895c7699dda4e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:04.506 INFO 34018 --- [ocp-async-4,e02469f2a8f14fe9,18fb9a022359bf4d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:04.796 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:04.797 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:04.833 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:04.834 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241226 2024-12-31 18:22:04.834 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:04.835 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:22:05.215 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:05.217 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:05.253 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:05.254 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241227 2024-12-31 18:22:05.254 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:05.255 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:22:05.609 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:05.611 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:05.646 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:05.647 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241228 2024-12-31 18:22:05.647 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:05.648 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:22:06.000 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:06.001 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:06.045 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:06.047 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241229 2024-12-31 18:22:06.047 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:06.048 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:22:06.415 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:06.417 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:06.451 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:06.452 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241230 2024-12-31 18:22:06.453 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:06.453 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:22:06.506 WARN 34018 --- [ocp-async-4,08d55441128f99bf,14d39f439c091fcf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:06.506 INFO 34018 --- [ocp-async-9,c5bff185545d7f46,ed813bcc91bace14] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:06.568 INFO 34018 --- [prometheus-minute-schedule-1,75161e0226033ea8,975e5abf1fede14b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:06.791 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:06.793 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:06.828 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:06.829 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20241231 2024-12-31 18:22:06.830 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:06.831 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:22:06.908 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:06.910 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:07.157 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:07.159 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:07.196 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:07.197 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20250101 2024-12-31 18:22:07.197 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:07.198 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:22:07.588 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:07.590 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:07.633 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:07.634 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20250102 2024-12-31 18:22:07.635 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:07.635 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:22:08.035 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:08.037 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:08.083 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:08.084 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20250103 2024-12-31 18:22:08.084 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:08.085 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:22:08.462 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:08.463 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:08.486 INFO 34018 --- [ocp-async-9,50a1d96a0ad2a45f,c5bb8436d91d1f10] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:22:08.505 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:08.506 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20250104 2024-12-31 18:22:08.506 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:08.506 WARN 34018 --- [ocp-async-8,4e36f5ce1a889d5b,53a2e208b3ac204e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:08.506 INFO 34018 --- [ocp-async-7,70e6ac390be037ad,451ac344d5a6cc3a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:08.507 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:22:08.510 INFO 34018 --- [ocp-schedules-16,abf3c548d6d2ed61,f7259e6db77647f7] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:22:08.591 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:22:08.590367+08:00, lastProcessTime=2024-12-31T18:21:58.590744+08:00 2024-12-31 18:22:08.791 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:22:08.590367+08:00 2024-12-31 18:22:08.881 INFO 34018 --- [ocp-schedules-7,3831c34e687de5e3,a550d4ac08bfe352] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:22:08.891 INFO 34018 --- [ocp-schedules-7,3831c34e687de5e3,a550d4ac08bfe352] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:22:08.891 INFO 34018 --- [ocp-schedules-7,3831c34e687de5e3,a550d4ac08bfe352] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:22:08.912 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:08.914 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:08.954 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:08.955 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20250105 2024-12-31 18:22:08.956 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:08.957 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:22:09.321 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:09.323 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:09.366 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:09.368 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20250106 2024-12-31 18:22:09.368 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:09.369 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:22:09.489 INFO 34018 --- [ocp-schedules-14,96a02a22fb112ee6,9097ee9adbbc401f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:22:09.568 INFO 34018 --- [prometheus-minute-schedule-1,a1990024ab73963c,67442e73e67c2a76] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:09.732 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:09.734 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:09.767 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:09.768 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20250107 2024-12-31 18:22:09.768 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:09.769 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:22:09.910 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:09.912 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:10.003 INFO 34018 --- [ocp-schedules-25,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:22:10.003 INFO 34018 --- [ocp-schedules-30,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:22:10.126 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:10.128 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:10.171 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:10.172 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_perf_sql_diagnosis, partition=P20250108 2024-12-31 18:22:10.172 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:10.173 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_perf_sql_diagnosis` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:22:10.507 WARN 34018 --- [ocp-async-2,dbeff7f1894bbabb,72341b87df25363b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:10.507 INFO 34018 --- [ocp-async-6,2faeda719fa97ecf,58340b671ce04a1c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:10.528 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:10.531 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_perf_sql_diagnosis' and table_type='BASE TABLE' 2024-12-31 18:22:10.569 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_perf_sql_diagnosis 2024-12-31 18:22:10.570 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:10.571 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:10.571 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:10.571 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_active_session_stat_0 2024-12-31 18:22:10.587 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20241223 2024-12-31 18:22:10.588 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:10.588 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20241223 values less than (1734998400000000)) 2024-12-31 18:22:10.818 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:10.820 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:10.863 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:10.864 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20241224 2024-12-31 18:22:10.865 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:10.865 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20241224 values less than (1735084800000000)) 2024-12-31 18:22:10.889 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-12-31 18:22:10.908 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-12-31 18:22:11.080 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:11.082 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:11.129 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:11.131 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20241225 2024-12-31 18:22:11.131 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:11.132 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20241225 values less than (1735171200000000)) 2024-12-31 18:22:11.354 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:11.356 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:11.398 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:11.399 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20241226 2024-12-31 18:22:11.399 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:11.400 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:22:11.603 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:11.605 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:11.646 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:11.647 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20241227 2024-12-31 18:22:11.647 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:11.648 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:22:11.861 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:11.863 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:11.905 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:11.906 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20241228 2024-12-31 18:22:11.907 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:11.908 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:22:12.132 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:12.134 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:12.175 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:12.177 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20241229 2024-12-31 18:22:12.177 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:12.178 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:22:12.403 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:12.405 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:12.450 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:12.451 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20241230 2024-12-31 18:22:12.452 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:12.453 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:22:12.507 WARN 34018 --- [ocp-async-3,8c651fe48a0528e0,c89d7e1cfe23fdd6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:12.507 INFO 34018 --- [ocp-async-1,8a98022caa2675db,18a29c2750d91276] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:12.568 INFO 34018 --- [prometheus-minute-schedule-1,4d82a6b2b07ab68e,6198dfdaa92d334f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:12.569 INFO 34018 --- [prometheus-hour-schedule-1,745ff87e7228b234,e5634b46b3ee00eb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:22:12.658 ERROR 34018 --- [metric-archive-second-15,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555165) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555165) Table has no partition for value 2024-12-31 18:22:12.659 ERROR 34018 --- [metric-archive-second-13,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555163) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555163) Table has no partition for value 2024-12-31 18:22:12.658 ERROR 34018 --- [metric-archive-second-28,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555176) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555176) Table has no partition for value 2024-12-31 18:22:12.658 ERROR 34018 --- [metric-archive-second-1,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221611189) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221611189) Table has no partition for value 2024-12-31 18:22:12.658 ERROR 34018 --- [metric-archive-second-36,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555081) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555081) Table has no partition for value 2024-12-31 18:22:12.658 ERROR 34018 --- [metric-archive-second-23,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555168) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555168) Table has no partition for value 2024-12-31 18:22:12.658 ERROR 34018 --- [metric-archive-second-25,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555179) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555179) Table has no partition for value 2024-12-31 18:22:12.661 ERROR 34018 --- [metric-archive-second-34,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555163) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555163) Table has no partition for value 2024-12-31 18:22:12.661 ERROR 34018 --- [metric-archive-second-16,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555179) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555179) Table has no partition for value 2024-12-31 18:22:12.661 ERROR 34018 --- [metric-archive-second-29,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555081) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555081) Table has no partition for value 2024-12-31 18:22:12.661 INFO 34018 --- [metric-archive-second-34,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.661 INFO 34018 --- [metric-archive-second-29,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.661 INFO 34018 --- [metric-archive-second-28,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.661 INFO 34018 --- [metric-archive-second-25,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.661 INFO 34018 --- [metric-archive-second-23,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.661 INFO 34018 --- [metric-archive-second-36,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.662 INFO 34018 --- [metric-archive-second-15,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.658 ERROR 34018 --- [metric-archive-second-30,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555156) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555156) Table has no partition for value 2024-12-31 18:22:12.662 INFO 34018 --- [metric-archive-second-13,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.662 INFO 34018 --- [metric-archive-second-30,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.662 INFO 34018 --- [metric-archive-second-1,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.662 ERROR 34018 --- [metric-archive-second-37,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555171) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555171) Table has no partition for value 2024-12-31 18:22:12.662 ERROR 34018 --- [metric-archive-second-4,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555168) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555168) Table has no partition for value 2024-12-31 18:22:12.662 ERROR 34018 --- [metric-archive-second-21,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555174) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555174) Table has no partition for value 2024-12-31 18:22:12.662 INFO 34018 --- [metric-archive-second-37,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.662 INFO 34018 --- [metric-archive-second-4,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.662 INFO 34018 --- [metric-archive-second-21,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.662 ERROR 34018 --- [metric-archive-second-38,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555156) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555156) Table has no partition for value 2024-12-31 18:22:12.662 ERROR 34018 --- [metric-archive-second-9,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555176) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555176) Table has no partition for value 2024-12-31 18:22:12.662 INFO 34018 --- [metric-archive-second-38,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.662 INFO 34018 --- [metric-archive-second-9,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.662 ERROR 34018 --- [metric-archive-second-5,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555165) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555165) Table has no partition for value 2024-12-31 18:22:12.658 ERROR 34018 --- [metric-archive-second-39,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555171) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555171) Table has no partition for value 2024-12-31 18:22:12.658 ERROR 34018 --- [metric-archive-second-31,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555159) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555159) Table has no partition for value 2024-12-31 18:22:12.661 INFO 34018 --- [metric-archive-second-16,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.664 ERROR 34018 --- [metric-archive-second-17,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221611189) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221611189) Table has no partition for value 2024-12-31 18:22:12.667 INFO 34018 --- [metric-archive-second-39,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.667 ERROR 34018 --- [metric-archive-second-21,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555156) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555156) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555156) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555156) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.667 ERROR 34018 --- [metric-archive-second-29,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555081) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555081) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555081) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555081) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.667 ERROR 34018 --- [metric-archive-second-28,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555179) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555179) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555179) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555179) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.667 ERROR 34018 --- [metric-archive-second-25,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555159) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555159) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555159) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555159) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.667 ERROR 34018 --- [metric-archive-second-36,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555174) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555174) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555174) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555174) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.667 ERROR 34018 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555176) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555176) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555176) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555176) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.667 ERROR 34018 --- [metric-archive-second-23,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555171) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555171) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555171) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555171) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.668 ERROR 34018 --- [metric-archive-second-9,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221611189) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221611189) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221611189) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221611189) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.668 ERROR 34018 --- [metric-archive-second-34,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555163) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555163) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555163) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555163) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.668 ERROR 34018 --- [metric-archive-second-30,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555168) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555168) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555168) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555168) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.668 INFO 34018 --- [metric-archive-second-5,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.668 INFO 34018 --- [metric-archive-second-31,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.668 INFO 34018 --- [metric-archive-second-17,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:22:12.668 ERROR 34018 --- [metric-archive-second-39,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555159) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555159) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555159) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555159) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.668 ERROR 34018 --- [metric-archive-second-37,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221611196) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221611196) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221611196) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221611196) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.669 ERROR 34018 --- [metric-archive-second-13,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555156) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555156) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555156) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555156) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.669 ERROR 34018 --- [metric-archive-second-38,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555165) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555165) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555165) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555165) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.669 ERROR 34018 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555179) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555179) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555179) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555179) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.669 ERROR 34018 --- [metric-archive-second-15,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555081) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555081) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555081) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555081) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.676 ERROR 34018 --- [metric-archive-second-16,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555168) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555168) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555168) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555168) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.676 ERROR 34018 --- [metric-archive-second-31,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555159) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555159) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555159) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555159) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.681 ERROR 34018 --- [metric-archive-second-5,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555156) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555156) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555156) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555156) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.681 ERROR 34018 --- [metric-archive-second-17,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555163) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555163) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555163) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555163) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:22:12.704 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:12.706 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:12.741 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:12.742 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20241231 2024-12-31 18:22:12.742 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:12.743 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:22:12.912 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:12.914 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:12.961 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:12.963 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:13.005 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:13.007 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20250101 2024-12-31 18:22:13.007 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:13.008 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:22:13.237 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:13.239 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:13.277 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:13.279 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20250102 2024-12-31 18:22:13.279 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:13.280 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:22:13.503 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:13.505 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:13.546 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:13.548 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20250103 2024-12-31 18:22:13.548 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:13.549 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:22:13.781 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:13.783 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:13.821 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:13.822 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20250104 2024-12-31 18:22:13.822 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:13.823 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:22:14.202 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:14.206 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:14.245 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:14.246 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20250105 2024-12-31 18:22:14.247 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:14.247 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:22:14.482 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:14.484 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:14.507 WARN 34018 --- [ocp-async-9,2a49b2c53cc9d420,99d407d65e26ba23] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:14.507 INFO 34018 --- [ocp-async-8,2af28d30eb8f2601,16d69ef344e2dda2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:14.524 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:14.525 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20250106 2024-12-31 18:22:14.525 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:14.526 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:22:14.760 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:14.762 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:14.804 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:14.805 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20250107 2024-12-31 18:22:14.805 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:14.806 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:22:15.022 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:15.024 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:15.064 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:15.065 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_active_session_stat_0, partition=P20250108 2024-12-31 18:22:15.066 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:15.067 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_active_session_stat_0` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:22:15.273 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:15.274 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_active_session_stat_0' and table_type='BASE TABLE' 2024-12-31 18:22:15.314 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_active_session_stat_0 2024-12-31 18:22:15.316 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:15.316 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:15.317 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:15.317 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_snapshot 2024-12-31 18:22:15.333 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_snapshot, partition=P202409 2024-12-31 18:22:15.333 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:15.334 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_snapshot` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:15.543 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:15.544 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_snapshot' and table_type='BASE TABLE' 2024-12-31 18:22:15.568 INFO 34018 --- [prometheus-minute-schedule-1,c22d1a42236cc588,3f874adc908d3c0a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:15.582 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_snapshot 2024-12-31 18:22:15.583 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_snapshot, partition=P202410 2024-12-31 18:22:15.584 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:15.584 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_snapshot` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:15.864 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:15.866 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_snapshot' and table_type='BASE TABLE' 2024-12-31 18:22:15.912 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_snapshot 2024-12-31 18:22:15.913 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_snapshot, partition=P202411 2024-12-31 18:22:15.913 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:15.914 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_snapshot` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:15.914 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:15.916 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:16.132 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:16.134 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_snapshot' and table_type='BASE TABLE' 2024-12-31 18:22:16.173 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_snapshot 2024-12-31 18:22:16.174 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_snapshot, partition=P202412 2024-12-31 18:22:16.175 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:16.176 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_snapshot` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:16.404 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:16.406 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_snapshot' and table_type='BASE TABLE' 2024-12-31 18:22:16.447 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_snapshot 2024-12-31 18:22:16.448 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_snapshot, partition=P202501 2024-12-31 18:22:16.448 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:16.449 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_snapshot` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:16.507 WARN 34018 --- [ocp-async-10,f7ef1ed50fa8ca33,812a1e16526a3013] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:16.507 INFO 34018 --- [ocp-async-7,934b00da0efbeca6,ba5266cf49b13701] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:16.685 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:16.686 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_snapshot' and table_type='BASE TABLE' 2024-12-31 18:22:16.727 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_snapshot 2024-12-31 18:22:16.728 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:16.728 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:16.729 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:16.729 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cluster 2024-12-31 18:22:16.746 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cluster, partition=P202409 2024-12-31 18:22:16.746 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:16.747 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cluster` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:16.967 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:16.968 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cluster' and table_type='BASE TABLE' 2024-12-31 18:22:17.009 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_cluster 2024-12-31 18:22:17.010 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cluster, partition=P202410 2024-12-31 18:22:17.010 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:17.011 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cluster` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:17.236 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:17.238 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cluster' and table_type='BASE TABLE' 2024-12-31 18:22:17.277 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_cluster 2024-12-31 18:22:17.279 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cluster, partition=P202411 2024-12-31 18:22:17.279 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:17.280 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cluster` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:17.494 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:17.496 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cluster' and table_type='BASE TABLE' 2024-12-31 18:22:17.531 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_cluster 2024-12-31 18:22:17.532 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cluster, partition=P202412 2024-12-31 18:22:17.533 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:17.533 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cluster` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:17.742 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:17.744 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cluster' and table_type='BASE TABLE' 2024-12-31 18:22:17.788 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_cluster 2024-12-31 18:22:17.789 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cluster, partition=P202501 2024-12-31 18:22:17.789 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:17.790 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cluster` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:18.019 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:18.021 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cluster' and table_type='BASE TABLE' 2024-12-31 18:22:18.061 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_cluster 2024-12-31 18:22:18.062 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:18.063 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:18.063 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:18.064 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_tenant 2024-12-31 18:22:18.079 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_tenant, partition=P202409 2024-12-31 18:22:18.080 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:18.081 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_tenant` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:18.304 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:18.306 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_tenant' and table_type='BASE TABLE' 2024-12-31 18:22:18.348 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_tenant 2024-12-31 18:22:18.349 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_tenant, partition=P202410 2024-12-31 18:22:18.350 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:18.350 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_tenant` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:18.457 INFO 34018 --- [ocp-schedules-8,6f4d5f811d524cbd,1ca01753df46f7df] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:22:18.458 INFO 34018 --- [ocp-schedules-28,fd50c4297c27e316,7559946e654a2d51] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:22:18.458 INFO 34018 --- [ocp-schedules-21,932ddffae95b3bd0,40f723dfd9e0c950] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:22:18.459 INFO 34018 --- [ocp-schedules-30,f294c87b27055a1e,f385a6b3abbe8cc8] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:22:18.464 INFO 34018 --- [ocp-schedules-20,f350b100fcf34faa,68b7481a19ab09ba] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:22:18.472 INFO 34018 --- [ocp-schedules-3,91ac35ef7d923fd2,c6cdb6ba0febefca] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:22:18.473 INFO 34018 --- [ocp-schedules-25,ff49eb838e86a552,6e3d887463dff95e] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:22:18.473 INFO 34018 --- [ocp-schedules-9,b5bff6e4f406d781,9cd1d287f23ddcc7] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:22:18.473 INFO 34018 --- [ocp-schedules-3,91ac35ef7d923fd2,c6cdb6ba0febefca] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:22:18.473 INFO 34018 --- [ocp-schedules-25,ff49eb838e86a552,6e3d887463dff95e] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:22:18.473 INFO 34018 --- [ocp-schedules-9,b5bff6e4f406d781,9cd1d287f23ddcc7] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:22:18.489 INFO 34018 --- [ocp-async-3,ec0c0ec8246171db,44cf427925a28706] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:22:18.507 WARN 34018 --- [ocp-async-7,f7ad1287a4493f9b,8dcfd922d064388c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:18.507 INFO 34018 --- [ocp-async-1,f04087317cfae4d9,e4055a782c123776] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:18.511 INFO 34018 --- [ocp-schedules-15,3c10c00e73cc72be,0ef9699b653fe5ce] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:22:18.533 INFO 34018 --- [ocp-schedules-4,48ffb0a57bf770f4,e1b81067ee381a78] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:22:18.568 INFO 34018 --- [prometheus-minute-schedule-1,92e631236061fb3e,f898b8fdabdb9cae] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:18.577 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:18.579 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_tenant' and table_type='BASE TABLE' 2024-12-31 18:22:18.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:22:18.589424+08:00, lastProcessTime=2024-12-31T18:22:08.590367+08:00 2024-12-31 18:22:18.618 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_tenant 2024-12-31 18:22:18.619 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_tenant, partition=P202411 2024-12-31 18:22:18.619 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:18.620 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_tenant` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:18.769 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:22:18.589424+08:00 2024-12-31 18:22:18.829 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:18.830 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_tenant' and table_type='BASE TABLE' 2024-12-31 18:22:18.869 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_tenant 2024-12-31 18:22:18.870 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_tenant, partition=P202412 2024-12-31 18:22:18.870 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:18.871 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_tenant` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:18.916 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:18.918 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:19.095 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:19.096 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_tenant' and table_type='BASE TABLE' 2024-12-31 18:22:19.132 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_tenant 2024-12-31 18:22:19.133 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_tenant, partition=P202501 2024-12-31 18:22:19.133 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:19.134 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_tenant` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:19.356 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:19.358 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_tenant' and table_type='BASE TABLE' 2024-12-31 18:22:19.395 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_tenant 2024-12-31 18:22:19.397 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:19.397 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:19.397 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:19.398 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_server 2024-12-31 18:22:19.410 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_server, partition=P202409 2024-12-31 18:22:19.411 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:19.411 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_server` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:19.609 INFO 34018 --- [ocp-schedules-20,6d165e6dc88a02f0,69d20154bf0887d6] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:22:19.637 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:19.639 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_server' and table_type='BASE TABLE' 2024-12-31 18:22:19.679 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_server 2024-12-31 18:22:19.680 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_server, partition=P202410 2024-12-31 18:22:19.680 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:19.681 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_server` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:19.893 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:19.894 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_server' and table_type='BASE TABLE' 2024-12-31 18:22:19.930 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_server 2024-12-31 18:22:19.930 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_server, partition=P202411 2024-12-31 18:22:19.931 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:19.932 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_server` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:20.142 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:20.144 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_server' and table_type='BASE TABLE' 2024-12-31 18:22:20.182 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_server 2024-12-31 18:22:20.183 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_server, partition=P202412 2024-12-31 18:22:20.184 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:20.184 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_server` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:20.422 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:20.423 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_server' and table_type='BASE TABLE' 2024-12-31 18:22:20.463 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_server 2024-12-31 18:22:20.465 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_server, partition=P202501 2024-12-31 18:22:20.465 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:20.466 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_server` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:20.508 WARN 34018 --- [ocp-async-9,60a10f9a883562e1,9f7c5e4c8b1835ea] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:20.508 INFO 34018 --- [ocp-async-8,ae9b4f7f06967bd6,1c8343d6307d9ebc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:20.699 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:20.701 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_server' and table_type='BASE TABLE' 2024-12-31 18:22:20.739 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_server 2024-12-31 18:22:20.740 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:20.741 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:20.741 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:20.742 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_replica 2024-12-31 18:22:20.756 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_replica, partition=P202409 2024-12-31 18:22:20.757 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:20.757 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_replica` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:20.967 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:20.969 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_replica' and table_type='BASE TABLE' 2024-12-31 18:22:21.013 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_replica 2024-12-31 18:22:21.014 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_replica, partition=P202410 2024-12-31 18:22:21.015 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:21.015 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_replica` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:21.230 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:21.232 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_replica' and table_type='BASE TABLE' 2024-12-31 18:22:21.280 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_replica 2024-12-31 18:22:21.281 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_replica, partition=P202411 2024-12-31 18:22:21.282 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:21.283 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_replica` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:21.501 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:21.503 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_replica' and table_type='BASE TABLE' 2024-12-31 18:22:21.543 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_replica 2024-12-31 18:22:21.544 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_replica, partition=P202412 2024-12-31 18:22:21.544 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:21.545 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_replica` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:21.568 INFO 34018 --- [prometheus-minute-schedule-1,8cd5eabf90128781,e0c627c85fbccf2f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:21.774 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:21.775 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_replica' and table_type='BASE TABLE' 2024-12-31 18:22:21.819 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_replica 2024-12-31 18:22:21.820 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_replica, partition=P202501 2024-12-31 18:22:21.820 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:21.821 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_replica` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:21.918 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:21.920 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:22.040 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:22.042 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_replica' and table_type='BASE TABLE' 2024-12-31 18:22:22.082 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_replica 2024-12-31 18:22:22.083 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:22.084 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:22.084 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:22.084 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sysstat 2024-12-31 18:22:22.099 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sysstat, partition=P202409 2024-12-31 18:22:22.099 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:22.099 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sysstat` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:22.315 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:22.316 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sysstat' and table_type='BASE TABLE' 2024-12-31 18:22:22.353 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sysstat 2024-12-31 18:22:22.354 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sysstat, partition=P202410 2024-12-31 18:22:22.354 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:22.355 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sysstat` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:22.508 WARN 34018 --- [ocp-async-8,1bd3ad56722f7953,239c440fb70bb92b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:22.508 INFO 34018 --- [ocp-async-6,61878bbbbfe340ca,0c84ec8b5be7e7e5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:22.587 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:22.589 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sysstat' and table_type='BASE TABLE' 2024-12-31 18:22:22.629 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sysstat 2024-12-31 18:22:22.630 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sysstat, partition=P202411 2024-12-31 18:22:22.631 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:22.631 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sysstat` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:22.860 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:22.862 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sysstat' and table_type='BASE TABLE' 2024-12-31 18:22:22.900 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sysstat 2024-12-31 18:22:22.901 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sysstat, partition=P202412 2024-12-31 18:22:22.902 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:22.903 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sysstat` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:23.123 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:23.124 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sysstat' and table_type='BASE TABLE' 2024-12-31 18:22:23.163 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sysstat 2024-12-31 18:22:23.164 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sysstat, partition=P202501 2024-12-31 18:22:23.164 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:23.165 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sysstat` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:23.385 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:23.387 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sysstat' and table_type='BASE TABLE' 2024-12-31 18:22:23.426 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sysstat 2024-12-31 18:22:23.428 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:23.428 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:23.429 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:23.429 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_row_lock 2024-12-31 18:22:23.443 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_row_lock, partition=P202409 2024-12-31 18:22:23.444 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:23.445 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_row_lock` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:23.659 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:23.661 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_row_lock' and table_type='BASE TABLE' 2024-12-31 18:22:23.702 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_row_lock 2024-12-31 18:22:23.703 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_row_lock, partition=P202410 2024-12-31 18:22:23.703 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:23.704 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_row_lock` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:23.938 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:23.940 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_row_lock' and table_type='BASE TABLE' 2024-12-31 18:22:23.983 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_row_lock 2024-12-31 18:22:23.984 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_row_lock, partition=P202411 2024-12-31 18:22:23.985 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:23.985 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_row_lock` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:24.205 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:24.207 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_row_lock' and table_type='BASE TABLE' 2024-12-31 18:22:24.249 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_row_lock 2024-12-31 18:22:24.250 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_row_lock, partition=P202412 2024-12-31 18:22:24.250 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:24.251 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_row_lock` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:24.483 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:24.485 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_row_lock' and table_type='BASE TABLE' 2024-12-31 18:22:24.508 WARN 34018 --- [ocp-async-7,afaaab50e340a6db,0350a41080fbe92b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:24.508 INFO 34018 --- [ocp-async-4,f0c102809aeb4d83,8c1bcc480ca0fdf2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:24.523 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_row_lock 2024-12-31 18:22:24.524 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_row_lock, partition=P202501 2024-12-31 18:22:24.525 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:24.525 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_row_lock` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:24.568 INFO 34018 --- [prometheus-minute-schedule-1,f02af7c6065d0292,bf6156c29fd52203] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:24.760 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:24.762 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_row_lock' and table_type='BASE TABLE' 2024-12-31 18:22:24.803 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_row_lock 2024-12-31 18:22:24.805 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:24.806 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:24.806 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:24.807 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_latch 2024-12-31 18:22:24.821 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_latch, partition=P202409 2024-12-31 18:22:24.821 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:24.822 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_latch` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:24.920 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:24.922 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:25.040 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:25.041 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_latch' and table_type='BASE TABLE' 2024-12-31 18:22:25.078 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_latch 2024-12-31 18:22:25.079 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_latch, partition=P202410 2024-12-31 18:22:25.079 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:25.080 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_latch` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:25.348 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:25.350 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_latch' and table_type='BASE TABLE' 2024-12-31 18:22:25.390 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_latch 2024-12-31 18:22:25.391 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_latch, partition=P202411 2024-12-31 18:22:25.392 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:25.393 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_latch` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:25.612 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:25.614 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_latch' and table_type='BASE TABLE' 2024-12-31 18:22:25.656 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_latch 2024-12-31 18:22:25.657 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_latch, partition=P202412 2024-12-31 18:22:25.658 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:25.659 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_latch` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:25.860 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:25.862 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_latch' and table_type='BASE TABLE' 2024-12-31 18:22:25.903 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_latch 2024-12-31 18:22:25.904 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_latch, partition=P202501 2024-12-31 18:22:25.904 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:25.905 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_latch` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:26.132 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:26.134 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_latch' and table_type='BASE TABLE' 2024-12-31 18:22:26.173 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_latch 2024-12-31 18:22:26.175 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:26.175 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:26.176 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:26.176 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cache 2024-12-31 18:22:26.190 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cache, partition=P202409 2024-12-31 18:22:26.191 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:26.191 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cache` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:26.409 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:26.411 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cache' and table_type='BASE TABLE' 2024-12-31 18:22:26.447 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_cache 2024-12-31 18:22:26.448 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cache, partition=P202410 2024-12-31 18:22:26.449 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:26.450 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cache` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:26.508 WARN 34018 --- [ocp-async-1,35b171e900cac7b1,9390233d8ae70347] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:26.508 INFO 34018 --- [ocp-async-9,39dedccfca8a49c6,9a7de4a2c4bff6a2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:26.716 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:26.717 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cache' and table_type='BASE TABLE' 2024-12-31 18:22:26.758 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_cache 2024-12-31 18:22:26.759 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cache, partition=P202411 2024-12-31 18:22:26.760 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:26.761 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cache` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:26.985 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:26.987 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cache' and table_type='BASE TABLE' 2024-12-31 18:22:27.030 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_cache 2024-12-31 18:22:27.031 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cache, partition=P202412 2024-12-31 18:22:27.032 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:27.032 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cache` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:27.257 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:27.259 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cache' and table_type='BASE TABLE' 2024-12-31 18:22:27.299 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_cache 2024-12-31 18:22:27.300 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_cache, partition=P202501 2024-12-31 18:22:27.300 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:27.301 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_cache` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:27.520 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:27.522 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_cache' and table_type='BASE TABLE' 2024-12-31 18:22:27.561 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_cache 2024-12-31 18:22:27.563 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:27.563 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:27.564 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:27.564 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_parameter 2024-12-31 18:22:27.568 INFO 34018 --- [prometheus-minute-schedule-1,7f2b89afe6240efb,e8dac84ef4fa36b4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:27.578 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_parameter, partition=P202409 2024-12-31 18:22:27.578 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:27.579 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_parameter` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:27.787 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:27.788 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_parameter' and table_type='BASE TABLE' 2024-12-31 18:22:27.830 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_parameter 2024-12-31 18:22:27.831 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_parameter, partition=P202410 2024-12-31 18:22:27.831 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:27.832 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_parameter` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:27.922 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:27.924 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:28.036 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:28.037 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_parameter' and table_type='BASE TABLE' 2024-12-31 18:22:28.078 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_parameter 2024-12-31 18:22:28.080 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_parameter, partition=P202411 2024-12-31 18:22:28.080 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:28.081 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_parameter` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:28.300 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:28.302 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_parameter' and table_type='BASE TABLE' 2024-12-31 18:22:28.344 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_parameter 2024-12-31 18:22:28.345 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_parameter, partition=P202412 2024-12-31 18:22:28.346 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:28.347 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_parameter` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:28.489 INFO 34018 --- [ocp-async-5,c2f902e80ba9ab17,7bcfd8e4d359c621] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:22:28.508 WARN 34018 --- [ocp-async-8,8f049a671641e20a,fe63633b4686dd1a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:28.508 INFO 34018 --- [ocp-async-2,d3bbd4f6b2c4c0fd,1e930b745872413d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:28.511 INFO 34018 --- [ocp-schedules-9,04862c2e617eb792,b6d313744752d094] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:22:28.559 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:28.560 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_parameter' and table_type='BASE TABLE' 2024-12-31 18:22:28.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:22:28.589531+08:00, lastProcessTime=2024-12-31T18:22:18.589424+08:00 2024-12-31 18:22:28.603 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_parameter 2024-12-31 18:22:28.604 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_parameter, partition=P202501 2024-12-31 18:22:28.605 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:28.605 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_parameter` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:28.774 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:22:28.589531+08:00 2024-12-31 18:22:28.817 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:28.819 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_parameter' and table_type='BASE TABLE' 2024-12-31 18:22:28.858 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_parameter 2024-12-31 18:22:28.860 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:28.860 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:28.861 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:28.861 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_rpc 2024-12-31 18:22:28.874 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_rpc, partition=P202409 2024-12-31 18:22:28.875 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:28.875 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_rpc` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:28.895 INFO 34018 --- [ocp-schedules-3,9fa28f03510d5b8b,2eac2dd0571eaee4] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:22:28.905 INFO 34018 --- [ocp-schedules-3,9fa28f03510d5b8b,2eac2dd0571eaee4] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:22:28.905 INFO 34018 --- [ocp-schedules-3,9fa28f03510d5b8b,2eac2dd0571eaee4] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:22:29.084 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:29.086 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_rpc' and table_type='BASE TABLE' 2024-12-31 18:22:29.128 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_rpc 2024-12-31 18:22:29.129 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_rpc, partition=P202410 2024-12-31 18:22:29.130 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:29.131 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_rpc` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:29.349 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:29.350 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_rpc' and table_type='BASE TABLE' 2024-12-31 18:22:29.386 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_rpc 2024-12-31 18:22:29.387 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_rpc, partition=P202411 2024-12-31 18:22:29.388 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:29.388 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_rpc` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:29.624 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:29.625 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_rpc' and table_type='BASE TABLE' 2024-12-31 18:22:29.663 INFO 34018 --- [ocp-schedules-11,835525247294927e,26efe9be4961567d] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:22:29.664 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_rpc 2024-12-31 18:22:29.666 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_rpc, partition=P202412 2024-12-31 18:22:29.666 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:29.667 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_rpc` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:29.887 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:29.889 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_rpc' and table_type='BASE TABLE' 2024-12-31 18:22:29.922 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_rpc 2024-12-31 18:22:29.923 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_rpc, partition=P202501 2024-12-31 18:22:29.923 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:29.924 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_rpc` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:30.141 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:30.142 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_rpc' and table_type='BASE TABLE' 2024-12-31 18:22:30.177 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_rpc 2024-12-31 18:22:30.178 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:30.179 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:30.179 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:30.179 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_packet 2024-12-31 18:22:30.191 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_packet, partition=P202409 2024-12-31 18:22:30.191 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:30.192 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_packet` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:30.397 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:30.398 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_packet' and table_type='BASE TABLE' 2024-12-31 18:22:30.432 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_packet 2024-12-31 18:22:30.433 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_packet, partition=P202410 2024-12-31 18:22:30.434 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:30.434 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_packet` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:30.508 WARN 34018 --- [ocp-async-7,e5abeefefb31f908,55137aaf77e5f053] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:30.509 INFO 34018 --- [ocp-async-3,2917108201425bac,b8f473021c6d095f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:30.568 INFO 34018 --- [prometheus-minute-schedule-1,605bc6b198291c05,901fd94f1de9295d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:30.670 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:30.672 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_packet' and table_type='BASE TABLE' 2024-12-31 18:22:30.714 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_packet 2024-12-31 18:22:30.715 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_packet, partition=P202411 2024-12-31 18:22:30.716 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:30.716 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_packet` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:30.923 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:30.924 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:30.925 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_packet' and table_type='BASE TABLE' 2024-12-31 18:22:30.927 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:30.967 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_packet 2024-12-31 18:22:30.968 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_packet, partition=P202412 2024-12-31 18:22:30.969 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:30.970 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_packet` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:31.181 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:31.185 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_packet' and table_type='BASE TABLE' 2024-12-31 18:22:31.229 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_packet 2024-12-31 18:22:31.230 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_packet, partition=P202501 2024-12-31 18:22:31.230 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:31.231 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_packet` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:31.435 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:31.437 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_packet' and table_type='BASE TABLE' 2024-12-31 18:22:31.478 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_packet 2024-12-31 18:22:31.479 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:31.480 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:31.480 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:31.481 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_clog 2024-12-31 18:22:31.497 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_clog, partition=P202409 2024-12-31 18:22:31.497 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:31.498 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_clog` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:31.713 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:31.714 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_clog' and table_type='BASE TABLE' 2024-12-31 18:22:31.756 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_clog 2024-12-31 18:22:31.757 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_clog, partition=P202410 2024-12-31 18:22:31.758 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:31.758 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_clog` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:31.994 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:31.996 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_clog' and table_type='BASE TABLE' 2024-12-31 18:22:32.033 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_clog 2024-12-31 18:22:32.035 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_clog, partition=P202411 2024-12-31 18:22:32.035 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:32.036 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_clog` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:32.263 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:32.264 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_clog' and table_type='BASE TABLE' 2024-12-31 18:22:32.303 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_clog 2024-12-31 18:22:32.304 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_clog, partition=P202412 2024-12-31 18:22:32.305 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:32.305 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_clog` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:32.509 WARN 34018 --- [ocp-async-9,ab935d4ab779958d,eab5c1712e4dcf0c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:32.509 INFO 34018 --- [ocp-async-3,6d23b8dde6493144,dd1a8ba6d118c3a9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:32.538 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:32.539 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_clog' and table_type='BASE TABLE' 2024-12-31 18:22:32.575 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_clog 2024-12-31 18:22:32.576 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_clog, partition=P202501 2024-12-31 18:22:32.576 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:32.577 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_clog` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:32.814 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:32.816 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_clog' and table_type='BASE TABLE' 2024-12-31 18:22:32.854 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_clog 2024-12-31 18:22:32.856 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:32.856 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:32.856 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:32.857 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_location_cache 2024-12-31 18:22:32.868 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_location_cache, partition=P202409 2024-12-31 18:22:32.869 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:32.869 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_location_cache` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:33.097 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:33.099 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_location_cache' and table_type='BASE TABLE' 2024-12-31 18:22:33.138 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_location_cache 2024-12-31 18:22:33.139 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_location_cache, partition=P202410 2024-12-31 18:22:33.140 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:33.140 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_location_cache` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:33.355 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:33.357 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_location_cache' and table_type='BASE TABLE' 2024-12-31 18:22:33.398 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_location_cache 2024-12-31 18:22:33.402 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_location_cache, partition=P202411 2024-12-31 18:22:33.403 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:33.403 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_location_cache` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:33.568 INFO 34018 --- [prometheus-minute-schedule-1,c88b222b3794480c,3b5622648b6c6ad3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:33.618 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:33.619 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_location_cache' and table_type='BASE TABLE' 2024-12-31 18:22:33.659 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_location_cache 2024-12-31 18:22:33.660 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_location_cache, partition=P202412 2024-12-31 18:22:33.661 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:33.662 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_location_cache` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:33.890 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:33.891 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_location_cache' and table_type='BASE TABLE' 2024-12-31 18:22:33.927 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:33.928 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_location_cache 2024-12-31 18:22:33.929 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:33.929 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_location_cache, partition=P202501 2024-12-31 18:22:33.930 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:33.930 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_location_cache` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:34.166 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:34.168 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_location_cache' and table_type='BASE TABLE' 2024-12-31 18:22:34.210 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_location_cache 2024-12-31 18:22:34.211 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:34.212 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:34.212 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:34.213 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_gts 2024-12-31 18:22:34.225 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_gts, partition=P202409 2024-12-31 18:22:34.226 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:34.226 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_gts` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:34.418 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:34.419 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_gts' and table_type='BASE TABLE' 2024-12-31 18:22:34.452 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_gts 2024-12-31 18:22:34.453 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_gts, partition=P202410 2024-12-31 18:22:34.453 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:34.453 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_gts` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:34.509 WARN 34018 --- [ocp-async-6,e2d30876c88dae60,fb679667d7d60132] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:34.509 INFO 34018 --- [ocp-async-5,a41ade684f71b726,4fb9a773dafbce6c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:34.861 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:34.862 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_gts' and table_type='BASE TABLE' 2024-12-31 18:22:34.900 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_gts 2024-12-31 18:22:34.901 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_gts, partition=P202411 2024-12-31 18:22:34.901 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:34.902 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_gts` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:35.122 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:35.123 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_gts' and table_type='BASE TABLE' 2024-12-31 18:22:35.157 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_gts 2024-12-31 18:22:35.158 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_gts, partition=P202412 2024-12-31 18:22:35.158 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:35.159 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_gts` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:35.377 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:35.379 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_gts' and table_type='BASE TABLE' 2024-12-31 18:22:35.421 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_gts 2024-12-31 18:22:35.422 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_gts, partition=P202501 2024-12-31 18:22:35.422 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:35.423 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_gts` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:35.718 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:35.719 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_gts' and table_type='BASE TABLE' 2024-12-31 18:22:35.761 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_gts 2024-12-31 18:22:35.762 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:35.763 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:35.763 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:35.764 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_system_event 2024-12-31 18:22:35.782 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_system_event, partition=P202409 2024-12-31 18:22:35.783 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:35.783 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_system_event` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:36.007 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:36.008 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:36.048 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_system_event 2024-12-31 18:22:36.049 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_system_event, partition=P202410 2024-12-31 18:22:36.049 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:36.050 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_system_event` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:36.274 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:36.276 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:36.318 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_system_event 2024-12-31 18:22:36.319 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_system_event, partition=P202411 2024-12-31 18:22:36.319 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:36.320 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_system_event` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:36.509 INFO 34018 --- [ocp-async-8,ce184e625a21d8a2,c138e4f1d33f2205] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:36.509 WARN 34018 --- [ocp-async-5,3a6943cdc2329bf0,9f9729632ebb9be9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:36.520 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2024-12-31T18:18:36.513, end=2024-12-31T18:20:36.513} 2024-12-31 18:22:36.523 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:36.524 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:36.537 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [] 2024-12-31 18:22:36.539 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2024-12-31 18:22:36.562 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_system_event 2024-12-31 18:22:36.563 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_system_event, partition=P202412 2024-12-31 18:22:36.564 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:36.564 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_system_event` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:36.568 INFO 34018 --- [prometheus-minute-schedule-1,2acd82c93a624396,079dc0991ae805a4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:36.569 INFO 34018 --- [prometheus-cache-monitor1,3e552337733a8c4c,7c8cc43fa8f0bda3] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":349,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":349,"seriesIdKeySize":349,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2024-12-31 18:22:36.569 INFO 34018 --- [prometheus-cache-monitor1,3e552337733a8c4c,7c8cc43fa8f0bda3] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=33, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=33, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:22:36.787 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:36.789 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:36.827 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_system_event 2024-12-31 18:22:36.829 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_system_event, partition=P202501 2024-12-31 18:22:36.829 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:36.830 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_system_event` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:36.929 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:36.931 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:37.052 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:37.053 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:37.091 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_system_event 2024-12-31 18:22:37.092 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:37.092 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:37.093 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:37.093 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_memory 2024-12-31 18:22:37.103 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_memory, partition=P202409 2024-12-31 18:22:37.104 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:37.104 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_memory` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:37.309 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:37.311 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_memory' and table_type='BASE TABLE' 2024-12-31 18:22:37.347 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_memory 2024-12-31 18:22:37.348 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_memory, partition=P202410 2024-12-31 18:22:37.349 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:37.349 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_memory` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:37.572 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:37.573 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_memory' and table_type='BASE TABLE' 2024-12-31 18:22:37.612 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_memory 2024-12-31 18:22:37.613 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_memory, partition=P202411 2024-12-31 18:22:37.613 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:37.614 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_memory` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:37.836 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:37.838 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_memory' and table_type='BASE TABLE' 2024-12-31 18:22:37.880 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_memory 2024-12-31 18:22:37.881 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_memory, partition=P202412 2024-12-31 18:22:37.882 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:37.882 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_memory` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:38.108 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:38.109 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_memory' and table_type='BASE TABLE' 2024-12-31 18:22:38.145 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_memory 2024-12-31 18:22:38.146 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_memory, partition=P202501 2024-12-31 18:22:38.146 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:38.147 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_memory` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:38.367 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:38.369 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_memory' and table_type='BASE TABLE' 2024-12-31 18:22:38.410 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_memory 2024-12-31 18:22:38.412 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:38.412 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:38.413 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:38.413 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_hit 2024-12-31 18:22:38.426 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_hit, partition=P202409 2024-12-31 18:22:38.426 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:38.426 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_hit` add partition(partition P202409 values less than (1727740800000000)) 2024-12-31 18:22:38.489 INFO 34018 --- [ocp-async-8,63de35ccc6bf928a,ee8ec79e95a5f4d1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:22:38.509 INFO 34018 --- [ocp-async-9,149e58b7b38439e8,5d5c1055b5669d5f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:38.509 WARN 34018 --- [ocp-async-3,ae27eb6b688a6e23,1ee76a90f0f88e8c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:38.511 INFO 34018 --- [ocp-schedules-9,7e06d3c5b9e00462,1104095a0dee457b] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:22:38.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:22:38.589611+08:00, lastProcessTime=2024-12-31T18:22:28.589531+08:00 2024-12-31 18:22:38.637 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:38.639 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_hit' and table_type='BASE TABLE' 2024-12-31 18:22:38.676 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_partition_hit 2024-12-31 18:22:38.677 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_hit, partition=P202410 2024-12-31 18:22:38.678 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:38.678 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_hit` add partition(partition P202410 values less than (1730419200000000)) 2024-12-31 18:22:38.767 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:22:38.589611+08:00 2024-12-31 18:22:38.893 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:38.895 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_hit' and table_type='BASE TABLE' 2024-12-31 18:22:38.936 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_partition_hit 2024-12-31 18:22:38.937 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_hit, partition=P202411 2024-12-31 18:22:38.938 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:38.939 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_hit` add partition(partition P202411 values less than (1733011200000000)) 2024-12-31 18:22:39.178 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:39.180 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_hit' and table_type='BASE TABLE' 2024-12-31 18:22:39.225 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_partition_hit 2024-12-31 18:22:39.226 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_hit, partition=P202412 2024-12-31 18:22:39.227 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:39.228 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_hit` add partition(partition P202412 values less than (1735689600000000)) 2024-12-31 18:22:39.472 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:39.474 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_hit' and table_type='BASE TABLE' 2024-12-31 18:22:39.514 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_partition_hit 2024-12-31 18:22:39.515 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_hit, partition=P202501 2024-12-31 18:22:39.515 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:39.516 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_hit` add partition(partition P202501 values less than (1738368000000000)) 2024-12-31 18:22:39.568 INFO 34018 --- [prometheus-minute-schedule-1,9e531ec5bf1b44fc,f2092ca3f9b4e7c8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:39.746 INFO 34018 --- [ocp-schedules-20,3201d07af232a66b,ee82f05dab4050b1] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:22:39.748 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:39.750 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_hit' and table_type='BASE TABLE' 2024-12-31 18:22:39.797 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_partition_hit 2024-12-31 18:22:39.798 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:39.799 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:39.799 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:39.800 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_plan_monitor 2024-12-31 18:22:39.821 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241216 2024-12-31 18:22:39.822 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:39.822 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241216 values less than (1734393600000000)) 2024-12-31 18:22:39.931 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:39.933 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:40.003 INFO 34018 --- [ocp-schedules-14,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:22:40.003 INFO 34018 --- [ocp-schedules-9,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:22:40.066 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:40.068 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:40.108 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:40.109 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241217 2024-12-31 18:22:40.109 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:40.110 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241217 values less than (1734480000000000)) 2024-12-31 18:22:40.378 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:40.379 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:40.414 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:40.415 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241218 2024-12-31 18:22:40.416 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:40.417 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241218 values less than (1734566400000000)) 2024-12-31 18:22:40.509 WARN 34018 --- [ocp-async-7,0ef2445e83021210,c5594efddac0218c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:40.509 INFO 34018 --- [ocp-async-9,74618f0aa0528efc,7eb10faebfd871c9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:40.691 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:40.693 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:40.736 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:40.737 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241219 2024-12-31 18:22:40.738 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:40.739 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241219 values less than (1734652800000000)) 2024-12-31 18:22:41.025 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:41.027 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:41.067 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:41.068 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241220 2024-12-31 18:22:41.068 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:41.069 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241220 values less than (1734739200000000)) 2024-12-31 18:22:41.371 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:41.373 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:41.412 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:41.413 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241221 2024-12-31 18:22:41.414 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:41.414 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241221 values less than (1734825600000000)) 2024-12-31 18:22:41.692 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:41.695 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:41.736 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:41.737 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241222 2024-12-31 18:22:41.738 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:41.739 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241222 values less than (1734912000000000)) 2024-12-31 18:22:42.021 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:42.023 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:42.067 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:42.069 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241223 2024-12-31 18:22:42.069 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:42.070 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241223 values less than (1734998400000000)) 2024-12-31 18:22:42.354 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:42.356 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:42.397 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:42.398 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241224 2024-12-31 18:22:42.399 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:42.400 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241224 values less than (1735084800000000)) 2024-12-31 18:22:42.510 WARN 34018 --- [ocp-async-1,5a57a67c7b171719,76f97f557a27f215] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:42.510 INFO 34018 --- [ocp-async-5,d6ada017fe4b83fe,cd7595bf43367f93] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:42.568 INFO 34018 --- [prometheus-minute-schedule-1,9ba315189801a75c,10080faf9f3ee20b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:42.677 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:42.679 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:42.719 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:42.720 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241225 2024-12-31 18:22:42.721 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:42.721 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241225 values less than (1735171200000000)) 2024-12-31 18:22:42.933 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:42.935 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:42.997 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:42.999 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:43.042 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:43.043 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241226 2024-12-31 18:22:43.043 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:43.044 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:22:43.339 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:43.340 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:43.376 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:43.377 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241227 2024-12-31 18:22:43.377 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:43.378 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:22:43.641 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:43.642 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:43.683 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:43.684 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241228 2024-12-31 18:22:43.685 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:43.685 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:22:43.940 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:43.942 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:43.977 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:43.978 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241229 2024-12-31 18:22:43.979 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:43.979 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:22:44.293 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:44.294 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:44.326 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:44.327 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241230 2024-12-31 18:22:44.327 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:44.328 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:22:44.510 WARN 34018 --- [ocp-async-3,db044b0c64a1ac73,9e4117f783091850] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:44.510 INFO 34018 --- [ocp-async-8,f0f23d4759403711,e241fdae17da39c6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:44.604 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:44.605 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:44.639 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:44.640 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20241231 2024-12-31 18:22:44.640 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:44.641 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:22:44.907 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:44.909 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:44.947 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:44.948 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20250101 2024-12-31 18:22:44.948 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:44.949 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:22:45.243 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:45.245 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:45.282 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:45.283 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20250102 2024-12-31 18:22:45.284 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:45.284 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:22:45.566 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:45.567 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:45.568 INFO 34018 --- [prometheus-minute-schedule-1,deb83499301fac9a,75f0da03fa761684] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:45.612 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:45.613 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20250103 2024-12-31 18:22:45.614 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:45.614 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:22:45.879 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:45.881 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:45.924 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:45.925 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20250104 2024-12-31 18:22:45.926 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:45.927 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:22:45.935 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:45.937 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:46.218 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:46.220 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:46.256 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:46.257 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20250105 2024-12-31 18:22:46.258 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:46.258 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:22:46.510 WARN 34018 --- [ocp-async-8,5123b4ccf986419e,fbe53db2be5e7060] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:46.510 INFO 34018 --- [ocp-async-6,f70fd422ad9d7360,1148a56c9ab4e9e8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:46.538 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:46.540 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:46.581 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:46.582 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20250106 2024-12-31 18:22:46.583 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:46.583 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:22:46.878 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:46.880 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:46.922 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:46.923 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_sql_plan_monitor, partition=P20250107 2024-12-31 18:22:46.923 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:46.924 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_sql_plan_monitor` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:22:47.204 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:47.206 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_sql_plan_monitor' and table_type='BASE TABLE' 2024-12-31 18:22:47.242 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_sql_plan_monitor 2024-12-31 18:22:47.244 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:47.244 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:47.245 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:47.245 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_trans_stat_v2 2024-12-31 18:22:47.271 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20241224 2024-12-31 18:22:47.272 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:47.272 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20241224 values less than (1735084800000000)) 2024-12-31 18:22:47.509 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,93012039faf5840c,b799743c7ab08c29] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=93012039faf5840c, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:22:47.509 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,00cdb7eaa94bd039,59edf34b7f77f606] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=00cdb7eaa94bd039, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:22:47.509 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,94c2003004d4745d,994f6e732a61a4ae] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=94c2003004d4745d, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:22:47.511 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,93012039faf5840c,b799743c7ab08c29] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=93012039faf5840c, duration=10 ms] 2024-12-31 18:22:47.511 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,94c2003004d4745d,994f6e732a61a4ae] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=94c2003004d4745d, duration=10 ms] 2024-12-31 18:22:47.513 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,e29a00de7b0c6cd4,5e375dbec5eb56e9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=e29a00de7b0c6cd4, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:22:47.514 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,e29a00de7b0c6cd4,5e375dbec5eb56e9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=e29a00de7b0c6cd4, duration=12 ms] 2024-12-31 18:22:47.514 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,00cdb7eaa94bd039,59edf34b7f77f606] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=00cdb7eaa94bd039, duration=16 ms] 2024-12-31 18:22:47.593 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:47.595 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:47.641 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:47.642 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20241225 2024-12-31 18:22:47.642 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:47.643 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20241225 values less than (1735171200000000)) 2024-12-31 18:22:48.060 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:48.062 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:48.110 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:48.111 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20241226 2024-12-31 18:22:48.112 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:48.113 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20241226 values less than (1735257600000000)) 2024-12-31 18:22:48.456 INFO 34018 --- [ocp-schedules-26,9cb45f5c0abc6e87,e3c2daa994eb8e00] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:22:48.457 INFO 34018 --- [ocp-schedules-10,a37364b8b8da84da,66207375b1e43069] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:22:48.458 INFO 34018 --- [ocp-schedules-3,8e9fe36fd8ab47c9,ada10e02bd97c23b] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:22:48.458 INFO 34018 --- [ocp-schedules-25,7182b9fa36819134,e093817dd7f036ae] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:22:48.458 INFO 34018 --- [ocp-schedules-1,8a47ee1a24d23372,ca2880bbbfcd7d71] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:22:48.458 INFO 34018 --- [ocp-schedules-27,bcc1b82d1813cfde,2c6ef7290b50a00c] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:22:48.463 INFO 34018 --- [ocp-schedules-26,9cb45f5c0abc6e87,e3c2daa994eb8e00] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:22:48.463 INFO 34018 --- [ocp-schedules-2,5eda6d5cfc114ada,ca7ea043891e4eed] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:22:48.466 INFO 34018 --- [ocp-schedules-1,8a47ee1a24d23372,ca2880bbbfcd7d71] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:22:48.470 INFO 34018 --- [ocp-schedules-28,72e01ca3c2aabf3b,6ee12e6523c41b93] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:22:48.470 INFO 34018 --- [ocp-schedules-28,72e01ca3c2aabf3b,6ee12e6523c41b93] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:22:48.470 INFO 34018 --- [ocp-schedules-17,b77fbb8a06f253b0,77c27af29005305e] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:22:48.470 INFO 34018 --- [ocp-schedules-17,b77fbb8a06f253b0,77c27af29005305e] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:22:48.470 INFO 34018 --- [ocp-schedules-4,29b40501313414dd,e416aeec588e67a7] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:22:48.470 INFO 34018 --- [ocp-schedules-4,29b40501313414dd,e416aeec588e67a7] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:22:48.479 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:48.481 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:48.489 INFO 34018 --- [ocp-async-1,9aa8c31bfeabcdfa,8db4bad759e7f521] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:22:48.503 INFO 34018 --- [ocp-schedules-16,4f780b9f96a6c1dc,8aab4151e0b68145] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[] 2024-12-31 18:22:48.503 INFO 34018 --- [ocp-schedules-16,4f780b9f96a6c1dc,8aab4151e0b68145] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2024-12-31 18:22:48.510 WARN 34018 --- [ocp-async-10,a6382b8fecb0bcba,6d427bdd088b5d04] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:48.510 INFO 34018 --- [ocp-async-4,0a253e0aea4e208a,a6818d62465f17bb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:48.512 INFO 34018 --- [ocp-schedules-23,727ac60d09b1c8a7,22ada18d16caa454] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:22:48.517 INFO 34018 --- [ocp-schedules-12,6c1a6e108cfb9efa,32f721147f0768af] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:22:48.518 INFO 34018 --- [ocp-schedules-14,08cb65974e3b3d40,d35f7009a2efd271] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:22:48.519 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:48.520 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20241227 2024-12-31 18:22:48.520 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:48.521 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20241227 values less than (1735344000000000)) 2024-12-31 18:22:48.528 INFO 34018 --- [ocp-schedules-27,2739e909178ff383,2013d60bbd17f70a] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:22:48.528+08:00, clusters=[] 2024-12-31 18:22:48.531 INFO 34018 --- [ocp-schedules-3,3acc0d22a6e357e6,36a33bbbbffe648a] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:22:48.531+08:00, clusters=[] 2024-12-31 18:22:48.531 INFO 34018 --- [ocp-schedules-3,041092487aa8888e,50e6b66c972ee1dd] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:22:48.531 INFO 34018 --- [ocp-schedules-3,041092487aa8888e,50e6b66c972ee1dd] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:22:48.531 INFO 34018 --- [ocp-schedules-10,e37faf7ba81c7a3b,20b0a62d44c7b3ed] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:22:48.533 INFO 34018 --- [ocp-schedules-3,041092487aa8888e,50e6b66c972ee1dd] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:22:48.533 INFO 34018 --- [ocp-schedules-3,041092487aa8888e,50e6b66c972ee1dd] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:22:48.536 INFO 34018 --- [ocp-schedules-2,0fcee118f9a457e3,b806d5d897c470df] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:22:48.536 INFO 34018 --- [ocp-schedules-2,646f0d32fd6ebd27,0b8ba320a338556f] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:22:48.536 INFO 34018 --- [ocp-schedules-2,646f0d32fd6ebd27,0b8ba320a338556f] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:22:48.543 INFO 34018 --- [ocp-schedules-25,f1d6b9129af229a7,f17c5fc36169727f] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:22:48.557 INFO 34018 --- [ocp-schedules-1,cfbc7fa64787b570,1a1a0b66eace8747] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:22:48.562 INFO 34018 --- [ocp-schedules-1,cfbc7fa64787b570,1a1a0b66eace8747] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:22:48.562 INFO 34018 --- [ocp-schedules-1,cfbc7fa64787b570,1a1a0b66eace8747] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 0 2024-12-31 18:22:48.568 INFO 34018 --- [prometheus-minute-schedule-1,5feaaf6237d56751,85960a4e4a2cda00] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:48.588 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:22:48.588146+08:00, lastProcessTime=2024-12-31T18:22:38.589611+08:00 2024-12-31 18:22:48.607 INFO 34018 --- [ocp-schedules-4,29dfeb91a4b576e1,4bc546f548d00bbe] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:22:48.607 INFO 34018 --- [ocp-schedules-4,29dfeb91a4b576e1,4bc546f548d00bbe] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:22:48.609 INFO 34018 --- [ocp-schedules-4,29dfeb91a4b576e1,4bc546f548d00bbe] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:22:48.609 INFO 34018 --- [ocp-schedules-4,29dfeb91a4b576e1,4bc546f548d00bbe] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:22:48.610 INFO 34018 --- [ocp-schedules-4,29dfeb91a4b576e1,4bc546f548d00bbe] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:22:48.610 INFO 34018 --- [ocp-schedules-4,29dfeb91a4b576e1,4bc546f548d00bbe] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730651867074035712 2024-12-31 18:22:48.748 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:22:48.588146+08:00 2024-12-31 18:22:48.877 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:48.879 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:48.910 INFO 34018 --- [ocp-schedules-8,074cb04a6718d538,e050297b8fd1d47c] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:22:48.918 INFO 34018 --- [ocp-schedules-8,074cb04a6718d538,e050297b8fd1d47c] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:22:48.918 INFO 34018 --- [ocp-schedules-8,074cb04a6718d538,e050297b8fd1d47c] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:22:48.921 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:48.922 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20241228 2024-12-31 18:22:48.923 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:48.923 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20241228 values less than (1735430400000000)) 2024-12-31 18:22:48.937 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:48.939 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:49.260 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:49.261 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:49.299 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:49.300 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20241229 2024-12-31 18:22:49.300 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:49.301 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20241229 values less than (1735516800000000)) 2024-12-31 18:22:49.661 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:49.663 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:49.705 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:49.706 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20241230 2024-12-31 18:22:49.707 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:49.707 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20241230 values less than (1735603200000000)) 2024-12-31 18:22:49.798 INFO 34018 --- [ocp-schedules-3,bd2d899d68d119db,6ca6a51f4070887c] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:22:50.052 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:50.054 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:50.085 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:50.086 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20241231 2024-12-31 18:22:50.086 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:50.087 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20241231 values less than (1735689600000000)) 2024-12-31 18:22:50.199 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2024-12-31 18:22:50.199 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.ocp.core.property.PropertyService : Refresh config properties 2024-12-31 18:22:50.208 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:22:50.208 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:22:50.208 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:22:50.208 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:22:50.217 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:22:50.217 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:22:50.217 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:22:50.217 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:22:50.262 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:22:50.270 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:22:50.270 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:22:50.270 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:22:50.270 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:22:50.270 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:22:50.280 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:22:50.431 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:50.433 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:50.546 INFO 34018 --- [ocp-async-4,921c45b5e3854691,c470724f83a9de13] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:50.546 WARN 34018 --- [ocp-async-7,8135394230f15fa1,4423decf549c3101] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:50.551 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:50.551 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20250101 2024-12-31 18:22:50.552 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:50.552 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20250101 values less than (1735776000000000)) 2024-12-31 18:22:50.848 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2024-12-31 18:22:50.874 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:50.876 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:50.916 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:50.917 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20250102 2024-12-31 18:22:50.918 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:50.918 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20250102 values less than (1735862400000000)) 2024-12-31 18:22:51.273 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:51.274 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:51.309 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:51.310 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20250103 2024-12-31 18:22:51.310 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:51.311 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20250103 values less than (1735948800000000)) 2024-12-31 18:22:51.381 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT1.163650351S 2024-12-31 18:22:51.381 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:22:51.473 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2024-12-31 18:22:51.474 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2024-12-31 18:22:51.507 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 2024-12-31 18:22:51.563 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:22:51.563 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:22:51.563 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:22:51.563 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:22:51.563 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:22:51.564 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2024-12-31 18:22:51.568 INFO 34018 --- [prometheus-minute-schedule-1,dc34c59d5544817e,38208a08d2fbb56b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:51.574 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:22:51.671 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:51.672 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:51.704 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:51.705 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20250104 2024-12-31 18:22:51.706 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:51.706 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20250104 values less than (1736035200000000)) 2024-12-31 18:22:51.736 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] o.s.boot.SpringApplication : Started application in 1.528 seconds (JVM running for 327.585) 2024-12-31 18:22:51.737 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT1.529015191S 2024-12-31 18:22:51.889 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:22:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:22:51.939 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:51.941 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:52.062 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:52.064 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:52.100 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:52.101 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20250105 2024-12-31 18:22:52.101 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:52.101 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20250105 values less than (1736121600000000)) 2024-12-31 18:22:52.204 INFO 34018 --- [ocp-schedules-26,d78db95f005f2a5c,7eb4a5a1e2ab3378] c.o.ocp.core.property.PropertyService : Refresh config properties done 2024-12-31 18:22:52.451 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:52.453 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:52.497 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:52.498 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20250106 2024-12-31 18:22:52.498 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:52.499 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20250106 values less than (1736208000000000)) 2024-12-31 18:22:52.546 INFO 34018 --- [ocp-async-4,2922abb81dc28239,9630178e0462aebc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:52.546 WARN 34018 --- [ocp-async-6,81db82a113ea7a8a,c1727bebb01c7090] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:52.868 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:52.869 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:52.909 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:52.910 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20250107 2024-12-31 18:22:52.911 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:52.912 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20250107 values less than (1736294400000000)) 2024-12-31 18:22:53.273 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:53.275 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:53.315 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:53.316 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_trans_stat_v2, partition=P20250108 2024-12-31 18:22:53.317 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:53.317 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_trans_stat_v2` add partition(partition P20250108 values less than (1736380800000000)) 2024-12-31 18:22:53.689 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:53.691 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_trans_stat_v2' and table_type='BASE TABLE' 2024-12-31 18:22:53.730 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_trans_stat_v2 2024-12-31 18:22:53.732 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:53.732 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:22:53.733 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:53.733 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_system_event 2024-12-31 18:22:53.756 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1732982400000000 2024-12-31 18:22:53.756 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:53.757 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1732982400000000 values less than (1732982400000000)) 2024-12-31 18:22:54.009 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:54.011 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:54.053 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:54.055 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1733068800000000 2024-12-31 18:22:54.055 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:54.056 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1733068800000000 values less than (1733068800000000)) 2024-12-31 18:22:54.329 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:54.331 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:54.370 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:54.371 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1733155200000000 2024-12-31 18:22:54.371 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:54.372 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1733155200000000 values less than (1733155200000000)) 2024-12-31 18:22:54.546 INFO 34018 --- [ocp-async-4,0c026e41b6054609,6fa07709b305908d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:54.546 WARN 34018 --- [ocp-async-3,1bf368f517a85a2c,bc9789733034368b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:54.568 INFO 34018 --- [prometheus-minute-schedule-1,7700cad1da00f7ca,c7b664b756ad70d2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:54.622 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:54.624 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:54.673 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:54.675 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1733241600000000 2024-12-31 18:22:54.675 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:54.676 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1733241600000000 values less than (1733241600000000)) 2024-12-31 18:22:54.941 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:54.943 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:54.965 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:54.967 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:55.007 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:55.009 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1733328000000000 2024-12-31 18:22:55.009 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:55.010 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1733328000000000 values less than (1733328000000000)) 2024-12-31 18:22:55.286 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:55.288 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:55.327 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:55.329 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1733414400000000 2024-12-31 18:22:55.329 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:55.330 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1733414400000000 values less than (1733414400000000)) 2024-12-31 18:22:55.620 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:55.622 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:55.662 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:55.663 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1733500800000000 2024-12-31 18:22:55.664 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:55.665 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1733500800000000 values less than (1733500800000000)) 2024-12-31 18:22:55.937 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:55.939 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:55.978 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:55.979 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1733587200000000 2024-12-31 18:22:55.979 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:55.980 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1733587200000000 values less than (1733587200000000)) 2024-12-31 18:22:56.350 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:56.351 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:56.389 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:56.389 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1733673600000000 2024-12-31 18:22:56.390 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:56.391 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1733673600000000 values less than (1733673600000000)) 2024-12-31 18:22:56.546 INFO 34018 --- [ocp-async-2,6b52001331a6b43e,ffeb51948557ad8b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:56.547 WARN 34018 --- [ocp-async-7,0460d22f9bc724b4,3304410687eacc87] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:56.686 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:56.687 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:56.719 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:56.720 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1733760000000000 2024-12-31 18:22:56.721 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:56.721 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1733760000000000 values less than (1733760000000000)) 2024-12-31 18:22:57.016 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:57.017 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:57.051 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:57.052 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1733846400000000 2024-12-31 18:22:57.052 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:57.053 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1733846400000000 values less than (1733846400000000)) 2024-12-31 18:22:57.350 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:57.352 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:57.394 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:57.395 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1733932800000000 2024-12-31 18:22:57.396 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:57.397 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1733932800000000 values less than (1733932800000000)) 2024-12-31 18:22:57.568 INFO 34018 --- [prometheus-minute-schedule-1,a8df3f1476b3403d,6e3d746e5cfdd262] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640580, interval=60 2024-12-31 18:22:57.705 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:57.707 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:57.747 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:57.748 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1734019200000000 2024-12-31 18:22:57.749 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:57.749 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1734019200000000 values less than (1734019200000000)) 2024-12-31 18:22:57.943 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:22:57.945 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:22:58.039 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:58.041 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:58.079 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:58.080 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1734105600000000 2024-12-31 18:22:58.080 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:58.081 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1734105600000000 values less than (1734105600000000)) 2024-12-31 18:22:58.393 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:58.396 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:58.433 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:58.434 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1734192000000000 2024-12-31 18:22:58.435 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:58.435 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1734192000000000 values less than (1734192000000000)) 2024-12-31 18:22:58.489 INFO 34018 --- [ocp-async-6,c38c5d91c2e921d3,e331ff99f4ff75f0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:22:58.512 INFO 34018 --- [ocp-schedules-13,375dfee206cb85cc,dc09ec5165a50ff9] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:22:58.547 INFO 34018 --- [ocp-async-9,377b03113aacbe07,df417f2d49c44e79] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:22:58.547 WARN 34018 --- [ocp-async-3,d94d69e5d0e11a78,f3aa132054603ea9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:22:58.588 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:22:58.587975+08:00, lastProcessTime=2024-12-31T18:22:48.588146+08:00 2024-12-31 18:22:58.727 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:22:58.587975+08:00 2024-12-31 18:22:58.734 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:58.736 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:58.770 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:58.771 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1734278400000000 2024-12-31 18:22:58.771 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:58.772 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1734278400000000 values less than (1734278400000000)) 2024-12-31 18:22:59.076 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:59.078 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:59.122 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:59.123 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1734364800000000 2024-12-31 18:22:59.124 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:59.125 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1734364800000000 values less than (1734364800000000)) 2024-12-31 18:22:59.427 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:59.429 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:59.473 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:59.474 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1734451200000000 2024-12-31 18:22:59.475 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:59.476 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1734451200000000 values less than (1734451200000000)) 2024-12-31 18:22:59.796 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:59.798 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:22:59.841 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:22:59.842 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1734537600000000 2024-12-31 18:22:59.842 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:22:59.843 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1734537600000000 values less than (1734537600000000)) 2024-12-31 18:22:59.864 INFO 34018 --- [ocp-schedules-20,84d974ef8fd56839,15b52e6f6bf2d0c0] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:23:00.148 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:00.149 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:00.187 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:00.188 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1734624000000000 2024-12-31 18:23:00.188 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:00.189 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1734624000000000 values less than (1734624000000000)) 2024-12-31 18:23:00.506 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:00.507 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:00.542 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:00.543 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1734710400000000 2024-12-31 18:23:00.543 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:00.544 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1734710400000000 values less than (1734710400000000)) 2024-12-31 18:23:00.547 INFO 34018 --- [ocp-async-5,ab3531528bfc7eb8,67dda416e141622d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:00.547 WARN 34018 --- [ocp-async-7,197650e8db35cd1a,b150b472805571b2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:00.568 INFO 34018 --- [prometheus-minute-schedule-1,f73ee6883b8a7518,70587cd35263d0a7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:00.865 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:00.866 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:00.899 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:00.900 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1734796800000000 2024-12-31 18:23:00.901 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:00.901 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1734796800000000 values less than (1734796800000000)) 2024-12-31 18:23:00.945 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:00.946 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:01.213 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:01.214 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:01.259 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:01.260 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1734883200000000 2024-12-31 18:23:01.260 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:01.261 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1734883200000000 values less than (1734883200000000)) 2024-12-31 18:23:01.633 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:01.634 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:01.674 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:01.675 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1734969600000000 2024-12-31 18:23:01.675 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:01.676 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1734969600000000 values less than (1734969600000000)) 2024-12-31 18:23:02.007 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:02.009 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:02.049 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:02.050 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1735056000000000 2024-12-31 18:23:02.050 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:02.051 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1735056000000000 values less than (1735056000000000)) 2024-12-31 18:23:02.399 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:02.400 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:02.438 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:02.439 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1735142400000000 2024-12-31 18:23:02.440 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:02.440 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1735142400000000 values less than (1735142400000000)) 2024-12-31 18:23:02.547 WARN 34018 --- [ocp-async-8,6b7e69c7452f81f7,13f29fab3ec79e47] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:02.547 INFO 34018 --- [ocp-async-5,1955002b931d2d42,62883e4281707bec] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:02.762 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:02.763 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:02.803 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:02.804 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1735228800000000 2024-12-31 18:23:02.804 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:02.805 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1735228800000000 values less than (1735228800000000)) 2024-12-31 18:23:03.147 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:03.149 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:03.189 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:03.191 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1735315200000000 2024-12-31 18:23:03.191 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:03.192 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1735315200000000 values less than (1735315200000000)) 2024-12-31 18:23:03.513 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:03.514 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:03.555 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:03.556 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1735401600000000 2024-12-31 18:23:03.556 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:03.557 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1735401600000000 values less than (1735401600000000)) 2024-12-31 18:23:03.568 INFO 34018 --- [prometheus-minute-schedule-1,aec8d0f3647fa21c,08d9e4486672b107] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:03.947 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:03.948 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:03.953 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:03.955 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:03.994 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:03.995 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1735488000000000 2024-12-31 18:23:03.995 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:03.996 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1735488000000000 values less than (1735488000000000)) 2024-12-31 18:23:04.345 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:04.347 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:04.386 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:04.387 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1735574400000000 2024-12-31 18:23:04.388 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:04.389 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1735574400000000 values less than (1735574400000000)) 2024-12-31 18:23:04.547 WARN 34018 --- [ocp-async-6,d9f53d876bef72cf,3c765aa6e87bf281] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:04.547 INFO 34018 --- [ocp-async-3,8ede9a7cdc60b61f,1d9756d488af4043] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:04.715 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:04.716 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:04.749 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:04.750 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1735660800000000 2024-12-31 18:23:04.751 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:04.751 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1735660800000000 values less than (1735660800000000)) 2024-12-31 18:23:05.135 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:05.136 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:05.175 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:05.176 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1735747200000000 2024-12-31 18:23:05.177 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:05.178 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1735747200000000 values less than (1735747200000000)) 2024-12-31 18:23:05.528 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:05.530 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:05.571 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:05.574 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_system_event, partition=p1735833600000000 2024-12-31 18:23:05.575 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:05.575 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_system_event` add partition(partition p1735833600000000 values less than (1735833600000000)) 2024-12-31 18:23:05.924 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:05.925 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_system_event' and table_type='BASE TABLE' 2024-12-31 18:23:05.963 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_system_event 2024-12-31 18:23:05.965 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:05.965 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:23:05.966 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:05.966 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_server_event 2024-12-31 18:23:05.989 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1732982400000000 2024-12-31 18:23:05.990 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:05.990 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1732982400000000 values less than (1732982400000000)) 2024-12-31 18:23:06.279 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:06.280 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:06.313 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:06.314 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1733068800000000 2024-12-31 18:23:06.314 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:06.315 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1733068800000000 values less than (1733068800000000)) 2024-12-31 18:23:06.547 WARN 34018 --- [ocp-async-7,8878fb289e4937b2,2371adee8c36c2b2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:06.547 INFO 34018 --- [ocp-async-9,25ef1cd8b805527c,776cc93d08e3cd72] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:06.568 INFO 34018 --- [prometheus-minute-schedule-1,550948f7815cf31c,bee6d51a43c188a9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:06.733 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:06.734 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:06.772 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:06.773 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1733155200000000 2024-12-31 18:23:06.773 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:06.774 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1733155200000000 values less than (1733155200000000)) 2024-12-31 18:23:06.948 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:06.950 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:07.130 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:07.131 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:07.166 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:07.167 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1733241600000000 2024-12-31 18:23:07.168 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:07.168 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1733241600000000 values less than (1733241600000000)) 2024-12-31 18:23:07.513 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:07.514 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:07.550 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:07.551 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1733328000000000 2024-12-31 18:23:07.552 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:07.552 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1733328000000000 values less than (1733328000000000)) 2024-12-31 18:23:07.917 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:07.918 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:07.951 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:07.952 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1733414400000000 2024-12-31 18:23:07.952 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:07.953 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1733414400000000 values less than (1733414400000000)) 2024-12-31 18:23:08.326 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:08.327 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:08.364 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:08.365 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1733500800000000 2024-12-31 18:23:08.365 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:08.366 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1733500800000000 values less than (1733500800000000)) 2024-12-31 18:23:08.490 INFO 34018 --- [ocp-async-10,3ecc59c25f8cf46f,b3acf3d47a30f161] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:23:08.512 INFO 34018 --- [ocp-schedules-7,2291ceeafed0d1f8,1e1db5a97f652a19] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:23:08.548 WARN 34018 --- [ocp-async-8,5570c04c4f6d74ce,5d0cc0a3982b0d16] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:08.548 INFO 34018 --- [ocp-async-5,edd16b644d413d1e,070fa3b8faaaf5cd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:08.588 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:23:08.587886+08:00, lastProcessTime=2024-12-31T18:22:58.587975+08:00 2024-12-31 18:23:08.753 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:23:08.587886+08:00 2024-12-31 18:23:08.761 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:08.763 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:08.793 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:08.795 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1733587200000000 2024-12-31 18:23:08.795 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:08.796 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1733587200000000 values less than (1733587200000000)) 2024-12-31 18:23:08.921 INFO 34018 --- [ocp-schedules-5,eec67d191a2fdd0a,68537e9111239bf6] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:23:08.930 INFO 34018 --- [ocp-schedules-5,eec67d191a2fdd0a,68537e9111239bf6] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:23:08.930 INFO 34018 --- [ocp-schedules-5,eec67d191a2fdd0a,68537e9111239bf6] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:23:09.158 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:09.159 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:09.196 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:09.197 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1733673600000000 2024-12-31 18:23:09.198 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:09.198 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1733673600000000 values less than (1733673600000000)) 2024-12-31 18:23:09.568 INFO 34018 --- [prometheus-minute-schedule-1,f677d3c9b2d3d6c5,a5ea738220325729] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:09.609 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:09.611 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:09.647 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:09.648 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1733760000000000 2024-12-31 18:23:09.649 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:09.649 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1733760000000000 values less than (1733760000000000)) 2024-12-31 18:23:09.907 INFO 34018 --- [ocp-schedules-15,c32e0f51d1046993,f570cf4d921f2f04] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:23:09.950 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:09.952 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:10.002 INFO 34018 --- [ocp-schedules-3,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:23:10.003 INFO 34018 --- [ocp-schedules-26,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:23:10.041 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:10.045 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:10.083 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:10.084 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1733846400000000 2024-12-31 18:23:10.085 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:10.085 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1733846400000000 values less than (1733846400000000)) 2024-12-31 18:23:10.463 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:10.465 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:10.507 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:10.508 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1733932800000000 2024-12-31 18:23:10.509 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:10.510 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1733932800000000 values less than (1733932800000000)) 2024-12-31 18:23:10.548 INFO 34018 --- [ocp-async-1,6836fa3edab04ade,559d9cf073882627] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:10.551 WARN 34018 --- [ocp-async-3,2f18ea28c95c875c,5c63ce88729ba38b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:10.889 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-12-31 18:23:10.891 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:10.892 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:10.908 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-12-31 18:23:10.935 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:10.936 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1734019200000000 2024-12-31 18:23:10.937 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:10.938 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1734019200000000 values less than (1734019200000000)) 2024-12-31 18:23:11.317 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:11.319 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:11.362 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:11.363 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1734105600000000 2024-12-31 18:23:11.364 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:11.365 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1734105600000000 values less than (1734105600000000)) 2024-12-31 18:23:11.835 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:11.837 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:11.880 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:11.882 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1734192000000000 2024-12-31 18:23:11.882 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:11.883 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1734192000000000 values less than (1734192000000000)) 2024-12-31 18:23:12.285 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:12.287 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:12.328 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:12.329 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1734278400000000 2024-12-31 18:23:12.329 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:12.330 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1734278400000000 values less than (1734278400000000)) 2024-12-31 18:23:12.548 WARN 34018 --- [ocp-async-7,495df787c91faff4,9b2bad43eedce94c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:12.548 INFO 34018 --- [ocp-async-4,c7faeb4466afef35,bca3e75c9fa4ad51] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:12.568 INFO 34018 --- [prometheus-minute-schedule-1,d7d6449689277429,c5ef0b9162f277a7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:12.569 INFO 34018 --- [prometheus-hour-schedule-1,ecff943a669f7c89,215fe896528a077e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:23:12.622 ERROR 34018 --- [metric-archive-second-30,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555156) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555156) Table has no partition for value 2024-12-31 18:23:12.622 ERROR 34018 --- [metric-archive-second-39,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555159) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555159) Table has no partition for value 2024-12-31 18:23:12.622 ERROR 34018 --- [metric-archive-second-15,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555081) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555081) Table has no partition for value 2024-12-31 18:23:12.622 ERROR 34018 --- [metric-archive-second-28,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555165) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555165) Table has no partition for value 2024-12-31 18:23:12.622 ERROR 34018 --- [metric-archive-second-32,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555163) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555163) Table has no partition for value 2024-12-31 18:23:12.622 INFO 34018 --- [metric-archive-second-32,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:23:12.622 INFO 34018 --- [metric-archive-second-28,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:23:12.622 INFO 34018 --- [metric-archive-second-30,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:23:12.622 INFO 34018 --- [metric-archive-second-15,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:23:12.622 ERROR 34018 --- [metric-archive-second-4,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555179) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555179) Table has no partition for value 2024-12-31 18:23:12.623 INFO 34018 --- [metric-archive-second-4,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:23:12.623 ERROR 34018 --- [metric-archive-second-40,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555168) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555168) Table has no partition for value 2024-12-31 18:23:12.623 INFO 34018 --- [metric-archive-second-40,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:23:12.623 ERROR 34018 --- [metric-archive-second-25,,] c.o.o.m.storage.RollupMetricDataDao : Archive node list to table metric_data_second error, e = PreparedStatementCallback; uncategorized SQLException for SQL [INSERT INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555171) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555171) Table has no partition for value 2024-12-31 18:23:12.623 INFO 34018 --- [metric-archive-second-25,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:23:12.623 INFO 34018 --- [metric-archive-second-39,,] c.o.o.m.storage.RollupMetricDataDao : Fallback to replace query. 2024-12-31 18:23:12.624 ERROR 34018 --- [metric-archive-second-30,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555156) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555156) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555156) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555156) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:23:12.624 ERROR 34018 --- [metric-archive-second-15,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555081) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555081) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555081) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555081) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:23:12.625 ERROR 34018 --- [metric-archive-second-32,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555163) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555163) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555163) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555163) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:23:12.625 ERROR 34018 --- [metric-archive-second-28,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555165) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555165) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555165) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555165) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:23:12.625 ERROR 34018 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555179) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555179) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555179) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555179) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:23:12.625 ERROR 34018 --- [metric-archive-second-39,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555159) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555159) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555159) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555159) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:23:12.625 ERROR 34018 --- [metric-archive-second-25,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555171) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555171) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555171) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555171) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:23:12.628 ERROR 34018 --- [metric-archive-second-40,,] c.o.o.m.service.OcpMetricArchiveService : Archive second nodes failed. org.springframework.jdbc.UncategorizedSQLException: PreparedStatementCallback; uncategorized SQLException for SQL [REPLACE INTO `metric_data_second` (`series_id`, `timestamp`, `data`, `interval`) VALUES (?, ?, ?, ?)]; SQL state [HY000]; error code [1526]; (conn=3221555168) Table has no partition for value; nested exception is java.sql.BatchUpdateException: (conn=3221555168) Table has no partition for value at org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1578) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:669) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:693) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1036) at org.springframework.jdbc.core.JdbcTemplate.batchUpdate(JdbcTemplate.java:1090) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDao.write(RollupMetricDataDao.java:79) at com.oceanbase.ocp.monitor.storage.RollupMetricDataDaoProxy.write(RollupMetricDataDaoProxy.java:55) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.lambda$archiveSecond$1(OcpMetricArchiveService.java:157) at com.oceanbase.ocp.common.meter.MeterUtils.time(MeterUtils.java:66) at com.oceanbase.ocp.common.meter.DistributionSummaryGroup.time(DistributionSummaryGroup.java:184) at com.oceanbase.ocp.monitor.service.OcpMetricArchiveService.archiveSecond(OcpMetricArchiveService.java:148) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.sql.BatchUpdateException: (conn=3221555168) Table has no partition for value at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:450) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:453) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:345) at com.zaxxer.hikari.pool.ProxyStatement.executeBatch(ProxyStatement.java:127) at com.zaxxer.hikari.pool.HikariProxyPreparedStatement.executeBatch(HikariProxyPreparedStatement.java) at org.springframework.jdbc.core.JdbcTemplate.lambda$batchUpdate$4(JdbcTemplate.java:1050) at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:650) ... 16 common frames omitted Caused by: java.sql.SQLTransientConnectionException: (conn=3221555168) Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:128) at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) at com.oceanbase.jdbc.OceanBaseStatement.executeBatchExceptionEpilogue(OceanBaseStatement.java:446) ... 22 common frames omitted Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Table has no partition for value at com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException.of(OceanBaseSqlException.java:79) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1252) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchClient(AbstractQueryProtocol.java:704) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternalBatch(JDBC4PreparedStatement.java:460) at com.oceanbase.jdbc.JDBC4PreparedStatement.executeBatch(JDBC4PreparedStatement.java:331) ... 20 common frames omitted Caused by: java.sql.SQLException: Table has no partition for value at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readErrorPacket(AbstractQueryProtocol.java:2347) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2210) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:2098) at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeBatchRewrite(AbstractQueryProtocol.java:1244) ... 23 common frames omitted 2024-12-31 18:23:12.746 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:12.747 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:12.785 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:12.786 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1734364800000000 2024-12-31 18:23:12.787 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:12.787 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1734364800000000 values less than (1734364800000000)) 2024-12-31 18:23:12.952 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:12.954 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:13.191 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:13.193 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:13.229 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:13.230 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1734451200000000 2024-12-31 18:23:13.231 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:13.231 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1734451200000000 values less than (1734451200000000)) 2024-12-31 18:23:13.631 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:13.633 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:13.675 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:13.676 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1734537600000000 2024-12-31 18:23:13.676 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:13.677 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1734537600000000 values less than (1734537600000000)) 2024-12-31 18:23:14.094 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:14.096 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:14.137 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:14.138 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1734624000000000 2024-12-31 18:23:14.139 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:14.139 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1734624000000000 values less than (1734624000000000)) 2024-12-31 18:23:14.548 WARN 34018 --- [ocp-async-8,e40c9e63dc635723,9bab794824a263bc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:14.549 INFO 34018 --- [ocp-async-2,80c644111f8b0fef,b336785eb28ec972] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:14.579 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:14.580 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:14.619 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:14.620 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1734710400000000 2024-12-31 18:23:14.621 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:14.623 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1734710400000000 values less than (1734710400000000)) 2024-12-31 18:23:15.034 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:15.035 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:15.076 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:15.077 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1734796800000000 2024-12-31 18:23:15.078 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:15.078 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1734796800000000 values less than (1734796800000000)) 2024-12-31 18:23:15.516 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:15.517 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:15.557 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:15.558 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1734883200000000 2024-12-31 18:23:15.559 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:15.560 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1734883200000000 values less than (1734883200000000)) 2024-12-31 18:23:15.568 INFO 34018 --- [prometheus-minute-schedule-1,ce81b7d8f4f1b41e,0a33ece506e84605] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:15.954 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:15.956 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:16.056 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:16.058 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:16.089 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:16.090 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1734969600000000 2024-12-31 18:23:16.090 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:16.090 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1734969600000000 values less than (1734969600000000)) 2024-12-31 18:23:16.464 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:16.466 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:16.497 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:16.498 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1735056000000000 2024-12-31 18:23:16.499 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:16.499 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1735056000000000 values less than (1735056000000000)) 2024-12-31 18:23:16.548 WARN 34018 --- [ocp-async-3,7b735bfe7d5fb087,2d9d547172063118] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:16.549 INFO 34018 --- [ocp-async-5,27baff5ea9b5d599,58a61a9dee684387] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:16.905 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:16.906 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:16.937 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:16.938 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1735142400000000 2024-12-31 18:23:16.939 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:16.939 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1735142400000000 values less than (1735142400000000)) 2024-12-31 18:23:17.332 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:17.333 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:17.366 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:17.367 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1735228800000000 2024-12-31 18:23:17.368 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:17.369 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1735228800000000 values less than (1735228800000000)) 2024-12-31 18:23:17.777 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:17.779 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:17.816 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:17.817 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1735315200000000 2024-12-31 18:23:17.817 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:17.818 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1735315200000000 values less than (1735315200000000)) 2024-12-31 18:23:18.231 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:18.232 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:18.265 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:18.266 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1735401600000000 2024-12-31 18:23:18.266 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:18.267 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1735401600000000 values less than (1735401600000000)) 2024-12-31 18:23:18.457 INFO 34018 --- [ocp-schedules-10,25d736b4b5ee416b,205e3f970dcab943] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:23:18.458 INFO 34018 --- [ocp-schedules-12,b0adb06879491af9,d7cdff0268cbde51] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:23:18.458 INFO 34018 --- [ocp-schedules-9,f70f04e65e0db930,350fd6f88ef384d5] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:23:18.458 INFO 34018 --- [ocp-schedules-14,90214f6f55228d3a,9eb6653b62b9c750] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:23:18.463 INFO 34018 --- [ocp-schedules-16,002759292ba2b8e9,22e684bb9d99edea] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:23:18.471 INFO 34018 --- [ocp-schedules-2,24e570f04b6f2c9d,b74b3b01154da6a1] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:23:18.471 INFO 34018 --- [ocp-schedules-2,24e570f04b6f2c9d,b74b3b01154da6a1] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:23:18.471 INFO 34018 --- [ocp-schedules-19,9974008d226ca86a,55b2bc493dde8156] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:23:18.471 INFO 34018 --- [ocp-schedules-19,9974008d226ca86a,55b2bc493dde8156] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:23:18.471 INFO 34018 --- [ocp-schedules-8,ac72f3007a4c0f08,a0a63eeff990e594] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:23:18.471 INFO 34018 --- [ocp-schedules-8,ac72f3007a4c0f08,a0a63eeff990e594] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:23:18.490 INFO 34018 --- [ocp-async-6,cfd692312136140d,f97e332391c4a8b4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:23:18.512 INFO 34018 --- [ocp-schedules-26,2901b4fec4d81145,a94bc2ccef828997] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:23:18.538 INFO 34018 --- [ocp-schedules-29,a997995365e47d9d,3461989209bc2e18] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:23:18.549 WARN 34018 --- [ocp-async-5,898e874e00f2174c,efff37deae2fa926] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:18.549 INFO 34018 --- [ocp-async-10,26df11cd7a7828eb,63d01dc7fa2bfd01] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:18.568 INFO 34018 --- [prometheus-minute-schedule-1,e0baa33a69bb88a5,5a0a89340f8ca408] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:18.592 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:23:18.592243+08:00, lastProcessTime=2024-12-31T18:23:08.587886+08:00 2024-12-31 18:23:18.688 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:18.689 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:18.721 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:18.721 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1735488000000000 2024-12-31 18:23:18.722 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:18.722 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1735488000000000 values less than (1735488000000000)) 2024-12-31 18:23:18.730 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:23:18.592243+08:00 2024-12-31 18:23:18.956 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:18.957 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:19.142 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:19.144 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:19.178 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:19.179 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1735574400000000 2024-12-31 18:23:19.180 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:19.180 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1735574400000000 values less than (1735574400000000)) 2024-12-31 18:23:19.606 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:19.607 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:19.641 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:19.642 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1735660800000000 2024-12-31 18:23:19.642 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:19.643 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1735660800000000 values less than (1735660800000000)) 2024-12-31 18:23:19.959 INFO 34018 --- [ocp-schedules-5,4b5a532ead856ed7,48f372dad1b845ec] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:23:20.068 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:20.069 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:20.103 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:20.103 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1735747200000000 2024-12-31 18:23:20.104 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:20.104 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1735747200000000 values less than (1735747200000000)) 2024-12-31 18:23:20.522 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:20.524 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:20.549 WARN 34018 --- [ocp-async-4,1da25085c1767b8f,d50175d824e99401] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:20.549 INFO 34018 --- [ocp-async-2,1adc06d2d3245c58,2cd7af8c4e56f2b8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:20.565 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:20.565 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_cluster_server_event, partition=p1735833600000000 2024-12-31 18:23:20.566 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:20.567 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_cluster_server_event` add partition(partition p1735833600000000 values less than (1735833600000000)) 2024-12-31 18:23:21.004 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:21.006 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_cluster_server_event' and table_type='BASE TABLE' 2024-12-31 18:23:21.047 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_cluster_server_event 2024-12-31 18:23:21.049 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:21.049 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:23:21.049 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:21.050 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_1 2024-12-31 18:23:21.062 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1734969600 2024-12-31 18:23:21.062 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:21.062 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1734969600 values less than (1734969600)) 2024-12-31 18:23:21.267 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:21.269 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2024-12-31 18:23:21.305 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_1 2024-12-31 18:23:21.306 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1735056000 2024-12-31 18:23:21.306 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:21.307 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1735056000 values less than (1735056000)) 2024-12-31 18:23:21.568 INFO 34018 --- [prometheus-minute-schedule-1,47e42945e32278c5,a2189cc63501f070] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:21.589 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:21.590 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2024-12-31 18:23:21.626 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_1 2024-12-31 18:23:21.627 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1735142400 2024-12-31 18:23:21.627 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:21.628 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1735142400 values less than (1735142400)) 2024-12-31 18:23:21.850 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:21.851 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2024-12-31 18:23:21.891 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_1 2024-12-31 18:23:21.892 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1735228800 2024-12-31 18:23:21.893 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:21.893 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1735228800 values less than (1735228800)) 2024-12-31 18:23:21.958 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:21.960 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:22.116 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:22.118 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2024-12-31 18:23:22.154 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_1 2024-12-31 18:23:22.155 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1735315200 2024-12-31 18:23:22.156 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:22.156 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1735315200 values less than (1735315200)) 2024-12-31 18:23:22.360 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:22.362 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2024-12-31 18:23:22.399 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_1 2024-12-31 18:23:22.400 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1735401600 2024-12-31 18:23:22.400 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:22.401 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1735401600 values less than (1735401600)) 2024-12-31 18:23:22.549 WARN 34018 --- [ocp-async-1,fa7d40e833699f06,f87dda035f929f21] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:22.549 INFO 34018 --- [ocp-async-6,4ddf7f14c751f1c7,c1e52c4ad31cb72b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:22.623 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:22.624 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2024-12-31 18:23:22.661 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_1 2024-12-31 18:23:22.662 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1735488000 2024-12-31 18:23:22.662 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:22.663 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1735488000 values less than (1735488000)) 2024-12-31 18:23:22.889 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:22.890 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2024-12-31 18:23:22.927 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_1 2024-12-31 18:23:22.928 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1735574400 2024-12-31 18:23:22.929 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:22.929 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1735574400 values less than (1735574400)) 2024-12-31 18:23:23.156 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:23.158 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2024-12-31 18:23:23.198 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_1 2024-12-31 18:23:23.199 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1735660800 2024-12-31 18:23:23.200 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:23.200 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1735660800 values less than (1735660800)) 2024-12-31 18:23:23.417 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:23.419 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2024-12-31 18:23:23.459 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_1 2024-12-31 18:23:23.460 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1735747200 2024-12-31 18:23:23.460 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:23.461 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1735747200 values less than (1735747200)) 2024-12-31 18:23:23.679 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:23.681 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2024-12-31 18:23:23.722 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_1 2024-12-31 18:23:23.723 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_1, partition=p1735833600 2024-12-31 18:23:23.724 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:23.724 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_1` add partition(partition p1735833600 values less than (1735833600)) 2024-12-31 18:23:23.956 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:23.958 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_1' and table_type='BASE TABLE' 2024-12-31 18:23:23.997 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_1 2024-12-31 18:23:23.998 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:23.998 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:23:23.999 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:23.999 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_60 2024-12-31 18:23:24.012 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1732982400 2024-12-31 18:23:24.013 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:24.013 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1732982400 values less than (1732982400)) 2024-12-31 18:23:24.224 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:24.226 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:24.266 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:24.267 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1733068800 2024-12-31 18:23:24.268 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:24.268 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1733068800 values less than (1733068800)) 2024-12-31 18:23:24.549 WARN 34018 --- [ocp-async-7,58ab1be0e7c9d2c3,172c46fb4ec661c6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:24.549 INFO 34018 --- [ocp-async-9,fa205e42acff4b44,299ce1909e5e11b7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:24.557 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:24.559 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:24.568 INFO 34018 --- [prometheus-minute-schedule-1,cdffc5ea757b1000,cdab048c151ff816] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:24.599 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:24.601 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1733155200 2024-12-31 18:23:24.601 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:24.602 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1733155200 values less than (1733155200)) 2024-12-31 18:23:24.819 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:24.820 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:24.858 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:24.860 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1733241600 2024-12-31 18:23:24.860 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:24.861 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1733241600 values less than (1733241600)) 2024-12-31 18:23:24.960 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:24.961 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:25.074 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:25.076 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:25.116 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:25.118 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1733328000 2024-12-31 18:23:25.118 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:25.119 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1733328000 values less than (1733328000)) 2024-12-31 18:23:25.406 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:25.408 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:25.448 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:25.449 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1733414400 2024-12-31 18:23:25.450 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:25.450 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1733414400 values less than (1733414400)) 2024-12-31 18:23:25.678 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:25.680 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:25.721 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:25.722 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1733500800 2024-12-31 18:23:25.723 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:25.724 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1733500800 values less than (1733500800)) 2024-12-31 18:23:25.957 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:25.959 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:25.996 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:25.997 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1733587200 2024-12-31 18:23:25.997 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:25.998 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1733587200 values less than (1733587200)) 2024-12-31 18:23:26.229 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:26.230 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:26.271 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:26.272 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1733673600 2024-12-31 18:23:26.272 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:26.273 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1733673600 values less than (1733673600)) 2024-12-31 18:23:26.489 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:26.491 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:26.528 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:26.529 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1733760000 2024-12-31 18:23:26.530 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:26.530 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1733760000 values less than (1733760000)) 2024-12-31 18:23:26.549 WARN 34018 --- [ocp-async-10,7f7a7c946e26d060,e386e5cf39c708d1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:26.549 INFO 34018 --- [ocp-async-8,cead80d9c82f2ef9,e73af5172bde40e6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:26.749 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:26.751 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:26.793 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:26.794 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1733846400 2024-12-31 18:23:26.794 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:26.795 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1733846400 values less than (1733846400)) 2024-12-31 18:23:27.019 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:27.021 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:27.064 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:27.065 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1733932800 2024-12-31 18:23:27.065 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:27.066 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1733932800 values less than (1733932800)) 2024-12-31 18:23:27.283 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:27.284 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:27.321 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:27.322 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1734019200 2024-12-31 18:23:27.322 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:27.323 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1734019200 values less than (1734019200)) 2024-12-31 18:23:27.545 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:27.547 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:27.568 INFO 34018 --- [prometheus-minute-schedule-1,5680f86bdb4160dd,4f88f8acef271990] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:27.590 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:27.591 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1734105600 2024-12-31 18:23:27.592 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:27.592 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1734105600 values less than (1734105600)) 2024-12-31 18:23:27.823 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:27.825 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:27.866 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:27.867 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1734192000 2024-12-31 18:23:27.867 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:27.868 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1734192000 values less than (1734192000)) 2024-12-31 18:23:27.962 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:27.963 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:28.099 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:28.101 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:28.142 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:28.143 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1734278400 2024-12-31 18:23:28.144 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:28.145 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1734278400 values less than (1734278400)) 2024-12-31 18:23:28.366 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:28.370 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:28.411 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:28.412 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1734364800 2024-12-31 18:23:28.412 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:28.413 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1734364800 values less than (1734364800)) 2024-12-31 18:23:28.490 INFO 34018 --- [ocp-async-8,e3748ce69e24d013,d3246aa5ac49ea7d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:23:28.512 INFO 34018 --- [ocp-schedules-9,37a5d114db169623,a3a7279152e8d5ab] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:23:28.550 WARN 34018 --- [ocp-async-1,882481256793c5bb,ccf056550adc5952] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:28.550 INFO 34018 --- [ocp-async-6,6720796bdc6e073e,51b1e6ffa2972ebb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:28.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:23:28.589635+08:00, lastProcessTime=2024-12-31T18:23:18.592243+08:00 2024-12-31 18:23:28.686 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:28.688 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:28.722 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:28.723 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1734451200 2024-12-31 18:23:28.724 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:28.724 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1734451200 values less than (1734451200)) 2024-12-31 18:23:28.761 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:23:28.589635+08:00 2024-12-31 18:23:28.933 INFO 34018 --- [ocp-schedules-17,69a0fdc211e24a80,3e7c405aff08269a] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:23:28.941 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:28.942 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:28.942 INFO 34018 --- [ocp-schedules-17,69a0fdc211e24a80,3e7c405aff08269a] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:23:28.942 INFO 34018 --- [ocp-schedules-17,69a0fdc211e24a80,3e7c405aff08269a] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:23:28.978 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:28.979 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1734537600 2024-12-31 18:23:28.980 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:28.981 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1734537600 values less than (1734537600)) 2024-12-31 18:23:29.274 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:29.275 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:29.308 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:29.309 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1734624000 2024-12-31 18:23:29.309 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:29.310 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1734624000 values less than (1734624000)) 2024-12-31 18:23:29.528 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:29.530 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:29.574 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:29.576 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1734710400 2024-12-31 18:23:29.576 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:29.577 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1734710400 values less than (1734710400)) 2024-12-31 18:23:29.815 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:29.817 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:29.861 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:29.862 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1734796800 2024-12-31 18:23:29.863 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:29.863 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1734796800 values less than (1734796800)) 2024-12-31 18:23:29.997 INFO 34018 --- [ocp-schedules-23,bcc57b71bf18a01c,d0bd3fa1663a7850] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:23:30.083 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:30.084 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:30.115 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:30.115 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1734883200 2024-12-31 18:23:30.116 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:30.116 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1734883200 values less than (1734883200)) 2024-12-31 18:23:30.340 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:30.341 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:30.373 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:30.374 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1734969600 2024-12-31 18:23:30.375 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:30.375 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1734969600 values less than (1734969600)) 2024-12-31 18:23:30.550 WARN 34018 --- [ocp-async-5,d1eb6ae9b1e73ab0,aeda40be77194137] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:30.550 INFO 34018 --- [ocp-async-7,362219911032a66b,b67e3fb80d5a2fd7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:30.568 INFO 34018 --- [prometheus-minute-schedule-1,c267d9f7bd95edc7,aff99ce8f9ffa3a6] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:30.596 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:30.597 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:30.631 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:30.632 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1735056000 2024-12-31 18:23:30.633 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:30.633 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1735056000 values less than (1735056000)) 2024-12-31 18:23:30.841 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:30.843 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:30.876 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:30.876 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1735142400 2024-12-31 18:23:30.877 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:30.877 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1735142400 values less than (1735142400)) 2024-12-31 18:23:30.964 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:30.965 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:31.175 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:31.177 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:31.238 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:31.239 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1735228800 2024-12-31 18:23:31.240 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:31.240 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1735228800 values less than (1735228800)) 2024-12-31 18:23:31.477 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:31.478 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:31.516 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:31.517 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1735315200 2024-12-31 18:23:31.517 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:31.518 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1735315200 values less than (1735315200)) 2024-12-31 18:23:31.725 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:31.727 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:31.767 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:31.768 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1735401600 2024-12-31 18:23:31.768 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:31.769 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1735401600 values less than (1735401600)) 2024-12-31 18:23:31.987 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:31.988 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:32.023 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:32.024 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1735488000 2024-12-31 18:23:32.025 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:32.025 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1735488000 values less than (1735488000)) 2024-12-31 18:23:32.255 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:32.257 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:32.297 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:32.298 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1735574400 2024-12-31 18:23:32.298 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:32.299 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1735574400 values less than (1735574400)) 2024-12-31 18:23:32.510 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:32.512 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:32.550 WARN 34018 --- [ocp-async-4,e67b9762884cebcc,04fde193d1f204a5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:32.550 INFO 34018 --- [ocp-async-10,c55758c258342c36,6eb29a783e7aa0eb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:32.555 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:32.556 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1735660800 2024-12-31 18:23:32.557 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:32.558 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1735660800 values less than (1735660800)) 2024-12-31 18:23:32.788 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:32.790 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:32.830 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:32.832 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1735747200 2024-12-31 18:23:32.832 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:32.833 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1735747200 values less than (1735747200)) 2024-12-31 18:23:33.067 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:33.068 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:33.108 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:33.109 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ocp_metric_data_60, partition=p1735833600 2024-12-31 18:23:33.109 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:33.110 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_metric_data_60` add partition(partition p1735833600 values less than (1735833600)) 2024-12-31 18:23:33.343 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:33.345 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ocp_metric_data_60' and table_type='BASE TABLE' 2024-12-31 18:23:33.386 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ocp_metric_data_60 2024-12-31 18:23:33.388 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:33.388 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:23:33.389 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:33.389 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_hour_data 2024-12-31 18:23:33.405 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2021 2024-12-31 18:23:33.405 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:33.406 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2021 values less than (1640995200)) 2024-12-31 18:23:33.568 INFO 34018 --- [prometheus-minute-schedule-1,70c450552288107d,7cf3a3e9664649c4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:33.635 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:33.637 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2024-12-31 18:23:33.677 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_hour_data 2024-12-31 18:23:33.678 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2022 2024-12-31 18:23:33.679 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:33.680 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2022 values less than (1672531200)) 2024-12-31 18:23:33.910 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:33.912 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2024-12-31 18:23:33.952 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_hour_data 2024-12-31 18:23:33.953 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2023 2024-12-31 18:23:33.954 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:33.955 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2023 values less than (1704067200)) 2024-12-31 18:23:33.965 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:33.967 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:34.171 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:34.172 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2024-12-31 18:23:34.213 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_hour_data 2024-12-31 18:23:34.214 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2024 2024-12-31 18:23:34.214 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:34.215 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2024 values less than (1735689600)) 2024-12-31 18:23:34.445 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:34.447 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2024-12-31 18:23:34.487 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_hour_data 2024-12-31 18:23:34.488 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2025 2024-12-31 18:23:34.488 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:34.489 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2025 values less than (1767225600)) 2024-12-31 18:23:34.550 WARN 34018 --- [ocp-async-1,518c8d1c572db359,5dc07a305b795692] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:34.550 INFO 34018 --- [ocp-async-2,44f908f09bc30eb6,ea661fbda93870af] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:34.740 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:34.741 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2024-12-31 18:23:34.779 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_hour_data 2024-12-31 18:23:34.780 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_hour_data, partition=p2026 2024-12-31 18:23:34.781 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:34.781 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_hour_data` add partition(partition p2026 values less than (1798761600)) 2024-12-31 18:23:35.005 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:35.007 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_hour_data' and table_type='BASE TABLE' 2024-12-31 18:23:35.050 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_hour_data 2024-12-31 18:23:35.052 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:35.052 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:23:35.053 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:35.053 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_daily_data 2024-12-31 18:23:35.067 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2021 2024-12-31 18:23:35.068 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:35.069 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2021 values less than (1640995200)) 2024-12-31 18:23:35.279 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:35.281 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2024-12-31 18:23:35.324 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_daily_data 2024-12-31 18:23:35.325 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2022 2024-12-31 18:23:35.326 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:35.327 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2022 values less than (1672531200)) 2024-12-31 18:23:35.564 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:35.566 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2024-12-31 18:23:35.608 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_daily_data 2024-12-31 18:23:35.610 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2023 2024-12-31 18:23:35.610 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:35.611 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2023 values less than (1704067200)) 2024-12-31 18:23:35.838 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:35.840 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2024-12-31 18:23:35.884 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_daily_data 2024-12-31 18:23:35.885 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2024 2024-12-31 18:23:35.886 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:35.887 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2024 values less than (1735689600)) 2024-12-31 18:23:36.097 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:36.099 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2024-12-31 18:23:36.135 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_daily_data 2024-12-31 18:23:36.136 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2025 2024-12-31 18:23:36.136 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:36.136 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2025 values less than (1767225600)) 2024-12-31 18:23:36.386 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:36.388 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2024-12-31 18:23:36.429 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_daily_data 2024-12-31 18:23:36.431 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_daily_data, partition=p2026 2024-12-31 18:23:36.431 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:36.432 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_daily_data` add partition(partition p2026 values less than (1798761600)) 2024-12-31 18:23:36.550 WARN 34018 --- [ocp-async-5,832615f5422ab5b5,3926e22ae06526e3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:36.551 INFO 34018 --- [ocp-async-6,1749b4319a6e19e1,b99e9bb6dd7bf139] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:36.568 INFO 34018 --- [prometheus-minute-schedule-1,186ffcbc3dec272a,1a4afd98f9a2e80e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:36.569 INFO 34018 --- [prometheus-cache-monitor1,4ff87c4be63118ab,49aafcd7ec2b8665] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":698,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":349,"seriesIdKeySize":349,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2024-12-31 18:23:36.570 INFO 34018 --- [prometheus-cache-monitor1,4ff87c4be63118ab,49aafcd7ec2b8665] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=33, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=33, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:23:36.663 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:36.665 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_daily_data' and table_type='BASE TABLE' 2024-12-31 18:23:36.707 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_daily_data 2024-12-31 18:23:36.708 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:36.709 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:23:36.710 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:36.710 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_second 2024-12-31 18:23:36.715 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20241224 2024-12-31 18:23:36.716 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:36.716 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20241224 values less than (1734969600)) 2024-12-31 18:23:36.967 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:36.969 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:36.989 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:36.990 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2024-12-31 18:23:37.029 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_second 2024-12-31 18:23:37.031 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20241225 2024-12-31 18:23:37.031 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:37.032 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20241225 values less than (1735056000)) 2024-12-31 18:23:37.302 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:37.304 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2024-12-31 18:23:37.338 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_second 2024-12-31 18:23:37.339 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20241226 2024-12-31 18:23:37.340 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:37.340 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20241226 values less than (1735142400)) 2024-12-31 18:23:37.645 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:37.647 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2024-12-31 18:23:37.686 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_second 2024-12-31 18:23:37.687 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20241227 2024-12-31 18:23:37.687 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:37.688 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20241227 values less than (1735228800)) 2024-12-31 18:23:37.972 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:37.973 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2024-12-31 18:23:38.013 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_second 2024-12-31 18:23:38.014 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20241228 2024-12-31 18:23:38.014 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:38.015 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20241228 values less than (1735315200)) 2024-12-31 18:23:38.274 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:38.276 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2024-12-31 18:23:38.316 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_second 2024-12-31 18:23:38.317 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20241229 2024-12-31 18:23:38.317 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:38.318 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20241229 values less than (1735401600)) 2024-12-31 18:23:38.490 INFO 34018 --- [ocp-async-6,47ccc42b8ecdada0,bc11a4f497bdac13] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:23:38.512 INFO 34018 --- [ocp-schedules-28,ce81941d94df04be,2fc42753162300f8] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:23:38.551 WARN 34018 --- [ocp-async-10,2547d15c7ce25668,953b1934478aa170] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:38.551 INFO 34018 --- [ocp-async-4,8cf359a5d4473cf8,52ac60faf8a93c16] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:38.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:23:38.589087+08:00, lastProcessTime=2024-12-31T18:23:28.589635+08:00 2024-12-31 18:23:38.602 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:38.604 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2024-12-31 18:23:38.640 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_second 2024-12-31 18:23:38.641 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20241230 2024-12-31 18:23:38.641 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:38.642 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20241230 values less than (1735488000)) 2024-12-31 18:23:38.763 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:23:38.589087+08:00 2024-12-31 18:23:38.943 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:38.944 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2024-12-31 18:23:38.980 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_second 2024-12-31 18:23:38.981 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20241231 2024-12-31 18:23:38.981 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:38.982 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20241231 values less than (1735574400)) 2024-12-31 18:23:39.284 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:39.286 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2024-12-31 18:23:39.323 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_second 2024-12-31 18:23:39.324 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20250101 2024-12-31 18:23:39.325 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:39.325 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20250101 values less than (1735660800)) 2024-12-31 18:23:39.568 INFO 34018 --- [prometheus-minute-schedule-1,fc3b994f67e61f3d,a90fa5444cfd70da] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:39.627 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:39.629 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2024-12-31 18:23:39.669 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_second 2024-12-31 18:23:39.671 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20250102 2024-12-31 18:23:39.671 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:39.672 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20250102 values less than (1735747200)) 2024-12-31 18:23:39.963 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:39.965 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2024-12-31 18:23:39.969 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:39.972 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:40.003 INFO 34018 --- [ocp-schedules-9,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:23:40.003 INFO 34018 --- [ocp-schedules-22,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:23:40.008 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_second 2024-12-31 18:23:40.009 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_second, partition=p20250103 2024-12-31 18:23:40.009 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:40.010 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_second` add partition(partition p20250103 values less than (1735833600)) 2024-12-31 18:23:40.061 INFO 34018 --- [ocp-schedules-17,e405777e94e8cb50,4e6ec8c9b6f48504] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:23:40.490 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:40.492 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_second' and table_type='BASE TABLE' 2024-12-31 18:23:40.534 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_second 2024-12-31 18:23:40.536 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:40.537 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:23:40.537 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:40.538 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_minute 2024-12-31 18:23:40.550 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241201 2024-12-31 18:23:40.551 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:40.551 WARN 34018 --- [ocp-async-4,c6472700f63b7f1b,5dd943dfa6dde062] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:40.551 INFO 34018 --- [ocp-async-1,6a1e51a8848cbdcc,213c3fdec5476b1f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:40.551 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241201 values less than (1732982400)) 2024-12-31 18:23:40.840 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:40.841 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:40.881 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:40.883 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241202 2024-12-31 18:23:40.883 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:40.884 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241202 values less than (1733068800)) 2024-12-31 18:23:41.184 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:41.186 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:41.227 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:41.228 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241203 2024-12-31 18:23:41.228 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:41.229 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241203 values less than (1733155200)) 2024-12-31 18:23:41.608 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:41.610 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:41.648 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:41.649 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241204 2024-12-31 18:23:41.649 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:41.650 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241204 values less than (1733241600)) 2024-12-31 18:23:41.948 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:41.949 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:41.987 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:41.988 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241205 2024-12-31 18:23:41.989 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:41.989 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241205 values less than (1733328000)) 2024-12-31 18:23:42.272 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:42.273 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:42.314 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:42.316 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241206 2024-12-31 18:23:42.316 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:42.317 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241206 values less than (1733414400)) 2024-12-31 18:23:42.551 WARN 34018 --- [ocp-async-1,b569d7a0c88b5b83,570eded289334360] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:42.551 INFO 34018 --- [ocp-async-9,35312085fb143861,cf326c7a55a66980] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:42.568 INFO 34018 --- [prometheus-minute-schedule-1,a2513651cea27dfa,ae3f1d2e904b54ba] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:42.854 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:42.856 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:42.895 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:42.897 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241207 2024-12-31 18:23:42.897 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:42.898 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241207 values less than (1733500800)) 2024-12-31 18:23:42.972 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:42.974 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:43.299 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:43.301 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:43.337 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:43.338 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241208 2024-12-31 18:23:43.338 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:43.339 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241208 values less than (1733587200)) 2024-12-31 18:23:43.625 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:43.627 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:43.667 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:43.668 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241209 2024-12-31 18:23:43.668 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:43.669 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241209 values less than (1733673600)) 2024-12-31 18:23:44.042 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:44.044 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:44.086 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:44.087 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241210 2024-12-31 18:23:44.088 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:44.089 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241210 values less than (1733760000)) 2024-12-31 18:23:44.551 WARN 34018 --- [ocp-async-7,d0bf693b8dac7b3f,25cff4e0e18c4d53] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:44.552 INFO 34018 --- [ocp-async-10,f4dedd5f0464e065,8e6f70076dc47904] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:44.568 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:44.570 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:44.609 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:44.610 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241211 2024-12-31 18:23:44.611 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:44.611 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241211 values less than (1733846400)) 2024-12-31 18:23:44.918 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:44.919 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:44.962 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:44.963 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241212 2024-12-31 18:23:44.964 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:44.965 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241212 values less than (1733932800)) 2024-12-31 18:23:45.255 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:45.257 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:45.296 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:45.297 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241213 2024-12-31 18:23:45.297 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:45.298 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241213 values less than (1734019200)) 2024-12-31 18:23:45.568 INFO 34018 --- [prometheus-minute-schedule-1,a938c98ed40bded1,417d29ffeca6bd42] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:45.646 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:45.649 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:45.691 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:45.692 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241214 2024-12-31 18:23:45.693 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:45.693 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241214 values less than (1734105600)) 2024-12-31 18:23:45.974 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:45.976 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:46.022 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:46.024 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:46.064 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:46.065 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241215 2024-12-31 18:23:46.065 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:46.066 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241215 values less than (1734192000)) 2024-12-31 18:23:46.379 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:46.380 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:46.417 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:46.418 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241216 2024-12-31 18:23:46.418 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:46.419 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241216 values less than (1734278400)) 2024-12-31 18:23:46.552 WARN 34018 --- [ocp-async-4,a4f03794b511809c,2a24814ad68ce67a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:46.552 INFO 34018 --- [ocp-async-2,1137aa9ecf7ef67d,91e66a1f00b64a34] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:46.771 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:46.773 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:46.813 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:46.814 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241217 2024-12-31 18:23:46.814 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:46.815 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241217 values less than (1734364800)) 2024-12-31 18:23:47.115 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:47.117 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:47.159 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:47.160 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241218 2024-12-31 18:23:47.160 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:47.161 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241218 values less than (1734451200)) 2024-12-31 18:23:47.470 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:47.472 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:47.515 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:47.516 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241219 2024-12-31 18:23:47.517 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:47.518 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241219 values less than (1734537600)) 2024-12-31 18:23:47.815 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:47.818 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:47.862 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:47.864 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241220 2024-12-31 18:23:47.864 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:47.865 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241220 values less than (1734624000)) 2024-12-31 18:23:48.200 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:48.201 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:48.240 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:48.242 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241221 2024-12-31 18:23:48.242 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:48.243 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241221 values less than (1734710400)) 2024-12-31 18:23:48.456 INFO 34018 --- [ocp-schedules-10,c1f43e73cb7021fd,fda3d060c5f17b15] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:23:48.457 INFO 34018 --- [ocp-schedules-3,364b85c6d6f02f17,227e2962376c0273] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:23:48.457 INFO 34018 --- [ocp-schedules-28,2dd12b232ecc7681,d7f1a797dbdc4ef8] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:23:48.458 INFO 34018 --- [ocp-schedules-11,46be4e1675c910d1,c36636fdc62d0426] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:23:48.458 INFO 34018 --- [ocp-schedules-6,1b95e798b7f9c16f,eb876774b566aec5] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:23:48.458 INFO 34018 --- [ocp-schedules-8,ef653eabb87213b5,76ec3326fe673688] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:23:48.465 INFO 34018 --- [ocp-schedules-6,1b95e798b7f9c16f,eb876774b566aec5] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:23:48.468 INFO 34018 --- [ocp-schedules-15,743b3f21250daee9,5623282ca3f52a57] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:23:48.470 INFO 34018 --- [ocp-schedules-10,c1f43e73cb7021fd,fda3d060c5f17b15] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:23:48.470 INFO 34018 --- [ocp-schedules-20,c9d8d0396c3b71f1,18affedaeeaf0fd0] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:23:48.470 INFO 34018 --- [ocp-schedules-20,c9d8d0396c3b71f1,18affedaeeaf0fd0] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:23:48.471 INFO 34018 --- [ocp-schedules-18,9ec18d1609ca3840,20f8a30e5f3eca4e] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:23:48.471 INFO 34018 --- [ocp-schedules-18,9ec18d1609ca3840,20f8a30e5f3eca4e] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:23:48.471 INFO 34018 --- [ocp-schedules-14,38d6102eeb96b761,38213415f7492fda] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:23:48.471 INFO 34018 --- [ocp-schedules-14,38d6102eeb96b761,38213415f7492fda] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:23:48.490 INFO 34018 --- [ocp-async-6,724f60e529577d39,d7449b43a04cf2c7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:23:48.506 INFO 34018 --- [ocp-schedules-22,3bbad893cb37e910,d195ea9ac022ef37] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2024-12-31 18:23:48.510 INFO 34018 --- [ocp-schedules-19,42c12f20167767eb,140b056921cef223] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[] 2024-12-31 18:23:48.510 INFO 34018 --- [ocp-schedules-19,42c12f20167767eb,140b056921cef223] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2024-12-31 18:23:48.513 INFO 34018 --- [ocp-schedules-17,ec21a40f2bb20461,37017148bb126ed1] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:23:48.515 INFO 34018 --- [ocp-schedules-9,c573e3a4c0a0d16a,6ad89674f35d8b33] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":698,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":349,"seriesIdKeySize":349,"secondWriteQueue":0,"minuteWriteCacheSize":0} 2024-12-31 18:23:48.515 INFO 34018 --- [ocp-schedules-9,c573e3a4c0a0d16a,6ad89674f35d8b33] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=33, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=33, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:23:48.521 INFO 34018 --- [ocp-schedules-13,49d714d1665e325c,03171df602bb3de1] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:23:48.522 INFO 34018 --- [ocp-schedules-7,093427df516ecc63,ddd88d298c13e907] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:23:48.530 INFO 34018 --- [ocp-schedules-12,8ec2642c929d9f27,9ae7819699efcb03] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:23:48.530+08:00, clusters=[] 2024-12-31 18:23:48.533 INFO 34018 --- [ocp-schedules-24,2c74a136950bed66,de63f0512c5fcba0] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:23:48.533+08:00, clusters=[] 2024-12-31 18:23:48.533 INFO 34018 --- [ocp-schedules-11,d496bd3286c1ec24,f95e97b4dcff63e8] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:23:48.534 INFO 34018 --- [ocp-schedules-8,1f15d64d08a3f7f6,0dd0a71ac2a2e63c] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:23:48.534 INFO 34018 --- [ocp-schedules-8,1f15d64d08a3f7f6,0dd0a71ac2a2e63c] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:23:48.535 INFO 34018 --- [ocp-schedules-8,1f15d64d08a3f7f6,0dd0a71ac2a2e63c] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:23:48.535 INFO 34018 --- [ocp-schedules-8,1f15d64d08a3f7f6,0dd0a71ac2a2e63c] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:23:48.539 INFO 34018 --- [ocp-schedules-6,f9944c470c63afd5,e410b1bd306f4040] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:23:48.539 INFO 34018 --- [ocp-schedules-6,f9944c470c63afd5,e410b1bd306f4040] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:23:48.540 INFO 34018 --- [ocp-schedules-28,a2ba0db281254c45,04b09e7b4c26afd5] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:23:48.545 INFO 34018 --- [ocp-schedules-15,3425ec2686fa5db2,bbe5fe52da90a95c] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:23:48.552 WARN 34018 --- [ocp-async-5,cc2b08e7e1b39c06,ed5df2a4d8ce89e0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:48.552 INFO 34018 --- [ocp-async-7,65f5e0da351b302d,198cbb4e3c5f1933] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:48.562 INFO 34018 --- [ocp-schedules-1,abff6a53ebfe05ad,f44499dc9785da05] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:23:48.566 INFO 34018 --- [ocp-schedules-1,abff6a53ebfe05ad,f44499dc9785da05] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:23:48.566 INFO 34018 --- [ocp-schedules-1,abff6a53ebfe05ad,f44499dc9785da05] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 0 2024-12-31 18:23:48.568 INFO 34018 --- [prometheus-minute-schedule-1,b89e18a8a5667f5f,d3fda9abd79e5192] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:48.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:23:48.588986+08:00, lastProcessTime=2024-12-31T18:23:38.589087+08:00 2024-12-31 18:23:48.600 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:48.601 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:48.602 INFO 34018 --- [ocp-schedules-23,ecccadc92466e01f,eff9664aab871163] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2024-12-31 18:23:48.610 INFO 34018 --- [ocp-schedules-23,ecccadc92466e01f,eff9664aab871163] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2024-12-31 18:23:48.611 INFO 34018 --- [ocp-schedules-27,fe71b05e85674f40,3fc4d7c5f1215263] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:23:48.611 INFO 34018 --- [ocp-schedules-27,fe71b05e85674f40,3fc4d7c5f1215263] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:23:48.617 INFO 34018 --- [ocp-schedules-27,fe71b05e85674f40,3fc4d7c5f1215263] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:23:48.617 INFO 34018 --- [ocp-schedules-27,fe71b05e85674f40,3fc4d7c5f1215263] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:23:48.623 INFO 34018 --- [ocp-schedules-27,fe71b05e85674f40,3fc4d7c5f1215263] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:23:48.623 INFO 34018 --- [ocp-schedules-27,fe71b05e85674f40,3fc4d7c5f1215263] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730651867074035712 2024-12-31 18:23:48.636 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:48.637 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241222 2024-12-31 18:23:48.638 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:48.638 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241222 values less than (1734796800)) 2024-12-31 18:23:48.741 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:23:48.588986+08:00 2024-12-31 18:23:48.926 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:48.928 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:48.945 INFO 34018 --- [ocp-schedules-4,acd0ca2534bab305,6729467014cd0416] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:23:48.956 INFO 34018 --- [ocp-schedules-4,acd0ca2534bab305,6729467014cd0416] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:23:48.956 INFO 34018 --- [ocp-schedules-4,acd0ca2534bab305,6729467014cd0416] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:23:48.969 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:48.970 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241223 2024-12-31 18:23:48.970 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:48.971 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241223 values less than (1734883200)) 2024-12-31 18:23:48.976 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:48.977 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:49.266 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:49.267 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:49.299 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:49.299 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241224 2024-12-31 18:23:49.300 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:49.300 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241224 values less than (1734969600)) 2024-12-31 18:23:49.614 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:49.616 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:49.654 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:49.655 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241225 2024-12-31 18:23:49.656 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:49.657 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241225 values less than (1735056000)) 2024-12-31 18:23:49.948 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:49.950 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:49.992 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:49.993 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241226 2024-12-31 18:23:49.994 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:49.994 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241226 values less than (1735142400)) 2024-12-31 18:23:50.102 INFO 34018 --- [ocp-schedules-2,5f69c54cc22f1a6b,91af8fd12e3e306a] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:23:50.283 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:50.284 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:50.320 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:50.321 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241227 2024-12-31 18:23:50.321 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:50.322 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241227 values less than (1735228800)) 2024-12-31 18:23:50.552 WARN 34018 --- [ocp-async-7,71efd18f13f31905,b0f72c95e9d9b142] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:50.552 INFO 34018 --- [ocp-async-4,9c12ac80401725d5,65e14191fabbed30] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:50.661 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:50.662 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:50.705 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:50.706 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241228 2024-12-31 18:23:50.707 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:50.708 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241228 values less than (1735315200)) 2024-12-31 18:23:51.049 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:51.051 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:51.094 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:51.095 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241229 2024-12-31 18:23:51.095 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:51.096 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241229 values less than (1735401600)) 2024-12-31 18:23:51.444 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:51.446 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:51.482 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:51.483 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241230 2024-12-31 18:23:51.483 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:51.484 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241230 values less than (1735488000)) 2024-12-31 18:23:51.568 INFO 34018 --- [prometheus-minute-schedule-1,99f631174b15983b,efd2c16991a16ca4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:51.889 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:23:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:23:51.978 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:51.979 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:51.979 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:51.981 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:52.020 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:52.021 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20241231 2024-12-31 18:23:52.022 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:52.022 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20241231 values less than (1735574400)) 2024-12-31 18:23:52.401 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:52.403 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:52.443 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:52.444 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20250101 2024-12-31 18:23:52.444 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:52.445 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20250101 values less than (1735660800)) 2024-12-31 18:23:52.552 WARN 34018 --- [ocp-async-1,c0cb2cce02c96a05,e4202349ac6fdc10] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:52.552 INFO 34018 --- [ocp-async-2,5c820739df2a2d6c,5c0acb41313cf0ed] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:52.856 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:52.857 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:52.897 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:52.898 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20250102 2024-12-31 18:23:52.898 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:52.899 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20250102 values less than (1735747200)) 2024-12-31 18:23:53.235 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:53.237 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:53.279 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:53.280 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_minute, partition=p20250103 2024-12-31 18:23:53.281 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:53.282 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_minute` add partition(partition p20250103 values less than (1735833600)) 2024-12-31 18:23:53.654 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:53.655 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_minute' and table_type='BASE TABLE' 2024-12-31 18:23:53.694 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_minute 2024-12-31 18:23:53.695 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:53.696 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:23:53.696 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:53.697 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_hour 2024-12-31 18:23:53.710 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2021 2024-12-31 18:23:53.710 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:53.711 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2021 values less than (1640995200)) 2024-12-31 18:23:54.184 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:54.186 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2024-12-31 18:23:54.227 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_hour 2024-12-31 18:23:54.228 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2022 2024-12-31 18:23:54.228 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:54.229 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2022 values less than (1672531200)) 2024-12-31 18:23:54.552 WARN 34018 --- [ocp-async-2,dbc6e34456e0b171,65f44b0a6fa4e4b4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:54.552 INFO 34018 --- [ocp-async-8,f1a42a08da0902ce,7c960296d9812f93] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:54.568 INFO 34018 --- [prometheus-minute-schedule-1,f0a0c7545a3733ff,b056a84fe0e79ba1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:54.592 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:54.593 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2024-12-31 18:23:54.633 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_hour 2024-12-31 18:23:54.634 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2023 2024-12-31 18:23:54.634 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:54.635 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2023 values less than (1704067200)) 2024-12-31 18:23:54.979 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:54.981 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:54.987 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:54.988 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2024-12-31 18:23:55.020 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_hour 2024-12-31 18:23:55.021 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2024 2024-12-31 18:23:55.021 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:55.022 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2024 values less than (1735689600)) 2024-12-31 18:23:55.377 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:55.382 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2024-12-31 18:23:55.426 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_hour 2024-12-31 18:23:55.427 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2025 2024-12-31 18:23:55.427 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:55.428 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2025 values less than (1767225600)) 2024-12-31 18:23:55.899 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:55.901 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2024-12-31 18:23:55.940 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_hour 2024-12-31 18:23:55.941 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_hour, partition=p2026 2024-12-31 18:23:55.941 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:55.942 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_hour` add partition(partition p2026 values less than (1798761600)) 2024-12-31 18:23:56.300 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:56.301 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_hour' and table_type='BASE TABLE' 2024-12-31 18:23:56.339 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_hour 2024-12-31 18:23:56.340 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:56.341 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:23:56.341 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:56.342 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_daily 2024-12-31 18:23:56.355 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2021 2024-12-31 18:23:56.355 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:56.356 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2021 values less than (1640995200)) 2024-12-31 18:23:56.553 WARN 34018 --- [ocp-async-7,87609b209ed44f09,06ebfab2973e0883] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:56.553 INFO 34018 --- [ocp-async-3,5cb943d91dc37605,08087e17e4bf6a6f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:56.625 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:56.627 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2024-12-31 18:23:56.664 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_daily 2024-12-31 18:23:56.665 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2022 2024-12-31 18:23:56.666 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:56.666 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2022 values less than (1672531200)) 2024-12-31 18:23:57.018 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:57.019 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2024-12-31 18:23:57.059 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_daily 2024-12-31 18:23:57.061 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2023 2024-12-31 18:23:57.061 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:57.062 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2023 values less than (1704067200)) 2024-12-31 18:23:57.376 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:57.377 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2024-12-31 18:23:57.411 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_daily 2024-12-31 18:23:57.412 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2024 2024-12-31 18:23:57.412 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:57.412 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2024 values less than (1735689600)) 2024-12-31 18:23:57.568 INFO 34018 --- [prometheus-minute-schedule-1,e32cafc0dc4ddd9d,fc0a352bb9d11fa4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640640, interval=60 2024-12-31 18:23:57.812 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:57.814 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2024-12-31 18:23:57.854 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_daily 2024-12-31 18:23:57.855 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2025 2024-12-31 18:23:57.855 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:57.856 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2025 values less than (1767225600)) 2024-12-31 18:23:57.981 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:23:57.983 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:23:58.221 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:58.222 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2024-12-31 18:23:58.261 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_daily 2024-12-31 18:23:58.262 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_daily, partition=p2026 2024-12-31 18:23:58.262 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:58.263 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_daily` add partition(partition p2026 values less than (1798761600)) 2024-12-31 18:23:58.491 INFO 34018 --- [ocp-async-1,e8c53c0e561b0bc4,22ea4322d4bd9061] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:23:58.513 INFO 34018 --- [ocp-schedules-17,fd5a63ae44f4ebd9,7e7ce836f2f5d23d] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:23:58.553 WARN 34018 --- [ocp-async-2,238c4d0573e106ed,445269ede030734b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:23:58.553 INFO 34018 --- [ocp-async-5,a7655b36b315c5b9,2d82be9b0d0cf8ee] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:23:58.588 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:23:58.587170+08:00, lastProcessTime=2024-12-31T18:23:48.588986+08:00 2024-12-31 18:23:58.665 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:58.666 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_daily' and table_type='BASE TABLE' 2024-12-31 18:23:58.699 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_daily 2024-12-31 18:23:58.701 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:58.701 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:23:58.702 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:58.702 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_async 2024-12-31 18:23:58.718 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_async, partition=p20241231 2024-12-31 18:23:58.718 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:58.719 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_async` add partition(partition p20241231 values less than (1735574400)) 2024-12-31 18:23:58.757 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:23:58.587170+08:00 2024-12-31 18:23:59.052 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:59.054 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_async' and table_type='BASE TABLE' 2024-12-31 18:23:59.091 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_async 2024-12-31 18:23:59.093 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_async, partition=p20250101 2024-12-31 18:23:59.093 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:59.094 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_async` add partition(partition p20250101 values less than (1735660800)) 2024-12-31 18:23:59.437 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:59.439 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_async' and table_type='BASE TABLE' 2024-12-31 18:23:59.482 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_async 2024-12-31 18:23:59.483 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_async, partition=p20250102 2024-12-31 18:23:59.483 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:59.484 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_async` add partition(partition p20250102 values less than (1735747200)) 2024-12-31 18:23:59.767 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:59.769 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_async' and table_type='BASE TABLE' 2024-12-31 18:23:59.815 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_async 2024-12-31 18:23:59.816 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=metric_data_async, partition=p20250103 2024-12-31 18:23:59.817 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:23:59.818 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `metric_data_async` add partition(partition p20250103 values less than (1735833600)) 2024-12-31 18:24:00.086 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:00.089 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='metric_data_async' and table_type='BASE TABLE' 2024-12-31 18:24:00.136 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=metric_data_async 2024-12-31 18:24:00.137 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:00.138 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:24:00.139 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:00.139 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table sql_aggregate_data 2024-12-31 18:24:00.153 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1734969600 2024-12-31 18:24:00.153 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:00.154 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1734969600 values less than (1734969600)) 2024-12-31 18:24:00.176 INFO 34018 --- [ocp-schedules-23,4c15d5c4d7e0c9ad,364cecdcd30d89a2] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:24:00.360 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:00.361 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2024-12-31 18:24:00.403 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=sql_aggregate_data 2024-12-31 18:24:00.404 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1735056000 2024-12-31 18:24:00.404 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:00.405 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1735056000 values less than (1735056000)) 2024-12-31 18:24:00.553 WARN 34018 --- [ocp-async-5,e6ce2aac85fdab1c,f2c6e90907282da5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:00.553 INFO 34018 --- [ocp-async-7,e1fd0c9cd48313be,a0b827fdf7d3acf2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:00.568 INFO 34018 --- [prometheus-minute-schedule-1,449094d0990b1c0c,ce47bbc8914ebc73] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:00.618 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:00.620 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2024-12-31 18:24:00.660 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=sql_aggregate_data 2024-12-31 18:24:00.662 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1735142400 2024-12-31 18:24:00.662 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:00.663 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1735142400 values less than (1735142400)) 2024-12-31 18:24:00.895 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:00.897 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2024-12-31 18:24:00.940 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=sql_aggregate_data 2024-12-31 18:24:00.941 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1735228800 2024-12-31 18:24:00.941 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:00.942 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1735228800 values less than (1735228800)) 2024-12-31 18:24:00.983 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:00.985 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:01.171 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:01.172 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2024-12-31 18:24:01.212 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=sql_aggregate_data 2024-12-31 18:24:01.213 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1735315200 2024-12-31 18:24:01.214 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:01.214 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1735315200 values less than (1735315200)) 2024-12-31 18:24:01.450 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:01.452 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2024-12-31 18:24:01.488 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=sql_aggregate_data 2024-12-31 18:24:01.489 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1735401600 2024-12-31 18:24:01.489 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:01.490 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1735401600 values less than (1735401600)) 2024-12-31 18:24:01.707 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:01.709 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2024-12-31 18:24:01.747 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=sql_aggregate_data 2024-12-31 18:24:01.748 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1735488000 2024-12-31 18:24:01.749 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:01.750 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1735488000 values less than (1735488000)) 2024-12-31 18:24:01.995 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:01.997 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2024-12-31 18:24:02.034 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=sql_aggregate_data 2024-12-31 18:24:02.035 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1735574400 2024-12-31 18:24:02.036 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:02.036 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1735574400 values less than (1735574400)) 2024-12-31 18:24:02.343 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:02.345 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2024-12-31 18:24:02.387 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=sql_aggregate_data 2024-12-31 18:24:02.388 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1735660800 2024-12-31 18:24:02.389 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:02.390 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1735660800 values less than (1735660800)) 2024-12-31 18:24:02.553 WARN 34018 --- [ocp-async-8,15d09f622ade1b44,95483a14361ac4ba] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:02.553 INFO 34018 --- [ocp-async-3,d9ddeeb3bf2c7a94,10adfe259e924c99] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:02.637 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:02.638 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2024-12-31 18:24:02.679 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=sql_aggregate_data 2024-12-31 18:24:02.680 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1735747200 2024-12-31 18:24:02.680 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:02.681 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1735747200 values less than (1735747200)) 2024-12-31 18:24:02.928 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:02.929 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2024-12-31 18:24:02.969 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=sql_aggregate_data 2024-12-31 18:24:02.970 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=sql_aggregate_data, partition=p1735833600 2024-12-31 18:24:02.971 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:02.972 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `sql_aggregate_data` add partition(partition p1735833600 values less than (1735833600)) 2024-12-31 18:24:03.310 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:03.312 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='sql_aggregate_data' and table_type='BASE TABLE' 2024-12-31 18:24:03.354 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=sql_aggregate_data 2024-12-31 18:24:03.356 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:03.356 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:24:03.356 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:03.357 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_stats_compressed 2024-12-31 18:24:03.369 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2021 2024-12-31 18:24:03.370 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:03.370 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2021 values less than (1640995200)) 2024-12-31 18:24:03.568 INFO 34018 --- [prometheus-minute-schedule-1,63f392eb54a6a92c,5c40933b418484df] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:03.643 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:03.644 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2024-12-31 18:24:03.681 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_partition_stats_compressed 2024-12-31 18:24:03.682 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2022 2024-12-31 18:24:03.683 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:03.683 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2022 values less than (1672531200)) 2024-12-31 18:24:03.985 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:03.988 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:03.994 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:03.995 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2024-12-31 18:24:04.034 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_partition_stats_compressed 2024-12-31 18:24:04.035 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2023 2024-12-31 18:24:04.036 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:04.036 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2023 values less than (1704067200)) 2024-12-31 18:24:04.209 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:04.211 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:24:04.212 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:04.213 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:24:04.213 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2024-12-31 18:24:04.216 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=3ms, period=120000ms 2024-12-31 18:24:04.356 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:04.358 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2024-12-31 18:24:04.400 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_partition_stats_compressed 2024-12-31 18:24:04.402 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2024 2024-12-31 18:24:04.402 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:04.403 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2024 values less than (1735689600)) 2024-12-31 18:24:04.553 WARN 34018 --- [ocp-async-6,4bfdf6e72ca023b2,9ecd63d4ecd21d37] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:04.554 INFO 34018 --- [ocp-async-10,616fec40c66a9f79,1abf5a67b263a969] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:04.722 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:04.723 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2024-12-31 18:24:04.758 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_partition_stats_compressed 2024-12-31 18:24:04.759 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2025 2024-12-31 18:24:04.759 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:04.760 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2025 values less than (1767225600)) 2024-12-31 18:24:05.081 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:05.083 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2024-12-31 18:24:05.124 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_partition_stats_compressed 2024-12-31 18:24:05.125 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_hist_partition_stats_compressed, partition=p2026 2024-12-31 18:24:05.126 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:05.127 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_hist_partition_stats_compressed` add partition(partition p2026 values less than (1798761600)) 2024-12-31 18:24:05.432 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:05.434 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_hist_partition_stats_compressed' and table_type='BASE TABLE' 2024-12-31 18:24:05.473 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_hist_partition_stats_compressed 2024-12-31 18:24:05.475 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:05.475 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:24:05.476 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:05.476 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_tenant_mini_compaction_info 2024-12-31 18:24:05.506 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1735056000 2024-12-31 18:24:05.506 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:05.507 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1735056000 values less than (1735056000)) 2024-12-31 18:24:05.778 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:05.780 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2024-12-31 18:24:05.820 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_tenant_mini_compaction_info 2024-12-31 18:24:05.821 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1735142400 2024-12-31 18:24:05.822 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:05.823 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1735142400 values less than (1735142400)) 2024-12-31 18:24:06.159 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:06.161 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2024-12-31 18:24:06.204 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_tenant_mini_compaction_info 2024-12-31 18:24:06.205 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1735228800 2024-12-31 18:24:06.205 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:06.206 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1735228800 values less than (1735228800)) 2024-12-31 18:24:06.549 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:06.551 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2024-12-31 18:24:06.554 WARN 34018 --- [ocp-async-9,94c57b83aab0dc8f,ea9dc4bd9116ed5f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:06.554 INFO 34018 --- [ocp-async-10,93c976c6576a2922,6cf9459fed818f9e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:06.568 INFO 34018 --- [prometheus-minute-schedule-1,02cd9eccd5d07d4b,f15da2e2f5f5067d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:06.590 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_tenant_mini_compaction_info 2024-12-31 18:24:06.591 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1735315200 2024-12-31 18:24:06.592 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:06.593 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1735315200 values less than (1735315200)) 2024-12-31 18:24:06.939 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:06.941 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2024-12-31 18:24:06.981 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_tenant_mini_compaction_info 2024-12-31 18:24:06.982 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1735401600 2024-12-31 18:24:06.982 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:06.983 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1735401600 values less than (1735401600)) 2024-12-31 18:24:06.988 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:06.989 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:07.323 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:07.324 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2024-12-31 18:24:07.362 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_tenant_mini_compaction_info 2024-12-31 18:24:07.363 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1735488000 2024-12-31 18:24:07.364 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:07.364 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1735488000 values less than (1735488000)) 2024-12-31 18:24:07.707 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:07.708 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2024-12-31 18:24:07.739 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_tenant_mini_compaction_info 2024-12-31 18:24:07.740 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1735574400 2024-12-31 18:24:07.740 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:07.741 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1735574400 values less than (1735574400)) 2024-12-31 18:24:08.074 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:08.076 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2024-12-31 18:24:08.111 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_tenant_mini_compaction_info 2024-12-31 18:24:08.112 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1735660800 2024-12-31 18:24:08.112 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:08.113 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1735660800 values less than (1735660800)) 2024-12-31 18:24:08.482 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:08.483 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2024-12-31 18:24:08.491 INFO 34018 --- [ocp-async-5,f985478da3c86864,637ef9b57e7b2833] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:24:08.513 INFO 34018 --- [ocp-schedules-18,5814b71ee94f79a0,80ef26e43323a111] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:24:08.523 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_tenant_mini_compaction_info 2024-12-31 18:24:08.524 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1735747200 2024-12-31 18:24:08.524 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:08.525 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1735747200 values less than (1735747200)) 2024-12-31 18:24:08.554 WARN 34018 --- [ocp-async-10,5943136bfdf67432,00e2ba08ab165344] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:08.554 INFO 34018 --- [ocp-async-4,b70773dba6c20d82,d328b012d63429c3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:08.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:24:08.588277+08:00, lastProcessTime=2024-12-31T18:23:58.587170+08:00 2024-12-31 18:24:08.739 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:24:08.588277+08:00 2024-12-31 18:24:08.829 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:08.830 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2024-12-31 18:24:08.860 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_tenant_mini_compaction_info 2024-12-31 18:24:08.860 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Monitordb, table=ob_tenant_mini_compaction_info, partition=p1735833600 2024-12-31 18:24:08.861 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:08.861 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ob_tenant_mini_compaction_info` add partition(partition p1735833600 values less than (1735833600)) 2024-12-31 18:24:08.959 INFO 34018 --- [ocp-schedules-30,2036b0754581eff4,156ea73aab33af7e] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:24:09.009 INFO 34018 --- [ocp-schedules-30,2036b0754581eff4,156ea73aab33af7e] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:24:09.009 INFO 34018 --- [ocp-schedules-30,2036b0754581eff4,156ea73aab33af7e] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:24:09.201 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:09.202 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='monitor_database' and table_name='ob_tenant_mini_compaction_info' and table_type='BASE TABLE' 2024-12-31 18:24:09.235 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Monitordb:table_name=ob_tenant_mini_compaction_info 2024-12-31 18:24:09.236 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Monitordb 2024-12-31 18:24:09.236 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Metadb 2024-12-31 18:24:09.236 INFO 34018 --- [part-initial-worker,,] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=null, obClusterId=null, tenantName=ocp_meta, username=root, address=10.79.169.37, port=2881, database=meta_database) 2024-12-31 18:24:09.236 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] create new ob connector, connectProperties=ConnectProperties(connectionMode=direct, address=10.79.169.37, port=2881, obsAddrList=null, username=root, tenantName=ocp_meta, clusterName=null, obClusterId=null, proxy=null, odpSocketConfig=null, vpcId=1, compatibilityMode=MYSQL, database=meta_database) 2024-12-31 18:24:09.245 INFO 34018 --- [obsdk-init-thread-2,18e1c3ed1fe4be2e,bb746d2227892c3e] com.alibaba.druid.pool.DruidDataSource : {dataSource-4,ob-connector-datasource_direct_ocp_meta_root_10.79.169.37_2881} inited 2024-12-31 18:24:09.245 INFO 34018 --- [obsdk-init-thread-2,18e1c3ed1fe4be2e,bb746d2227892c3e] c.o.o.o.c.impl.AbstractConnector : [obsdk] init druid datasource success, poolingCount=1, connectProperties=ConnectProperties(connectionMode=direct, address=10.79.169.37, port=2881, obsAddrList=null, username=root, tenantName=ocp_meta, clusterName=null, obClusterId=null, proxy=null, odpSocketConfig=null, vpcId=1, compatibilityMode=MYSQL, database=meta_database) 2024-12-31 18:24:09.245 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] create new ob connector success 2024-12-31 18:24:09.247 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:09.247 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:24:09.250 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:09.250 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:24:09.251 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:09.251 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table profile_credential_sharing 2024-12-31 18:24:09.268 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1735056000 2024-12-31 18:24:09.269 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:09.269 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1735056000 values less than (1735056000)) 2024-12-31 18:24:09.568 INFO 34018 --- [prometheus-minute-schedule-1,c63c3d134b32da51,7aa91703aee0daab] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:09.628 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:09.630 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2024-12-31 18:24:09.710 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=profile_credential_sharing 2024-12-31 18:24:09.711 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1735142400 2024-12-31 18:24:09.711 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:09.712 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1735142400 values less than (1735142400)) 2024-12-31 18:24:09.990 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:09.992 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:10.003 INFO 34018 --- [ocp-schedules-1,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:24:10.003 INFO 34018 --- [ocp-schedules-17,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:24:10.091 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:10.092 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2024-12-31 18:24:10.145 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=profile_credential_sharing 2024-12-31 18:24:10.145 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1735228800 2024-12-31 18:24:10.146 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:10.146 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1735228800 values less than (1735228800)) 2024-12-31 18:24:10.213 INFO 34018 --- [ocp-schedules-27,345f09a99d9dfa28,8e15e2a93e74c69f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:24:10.384 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:10.385 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2024-12-31 18:24:10.417 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=profile_credential_sharing 2024-12-31 18:24:10.417 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1735315200 2024-12-31 18:24:10.418 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:10.418 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1735315200 values less than (1735315200)) 2024-12-31 18:24:10.554 WARN 34018 --- [ocp-async-4,9bbd5c86614a3eac,1809d14ae9b09573] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:10.554 INFO 34018 --- [ocp-async-3,bbc86518eea4f162,5259ef77f185710b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:10.692 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:10.693 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2024-12-31 18:24:10.732 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=profile_credential_sharing 2024-12-31 18:24:10.733 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1735401600 2024-12-31 18:24:10.734 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:10.734 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1735401600 values less than (1735401600)) 2024-12-31 18:24:10.889 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-12-31 18:24:10.908 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-12-31 18:24:11.040 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:11.042 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2024-12-31 18:24:11.081 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=profile_credential_sharing 2024-12-31 18:24:11.082 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1735488000 2024-12-31 18:24:11.083 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:11.083 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1735488000 values less than (1735488000)) 2024-12-31 18:24:11.385 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:11.387 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2024-12-31 18:24:11.424 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=profile_credential_sharing 2024-12-31 18:24:11.425 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1735574400 2024-12-31 18:24:11.425 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:11.426 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1735574400 values less than (1735574400)) 2024-12-31 18:24:11.729 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:11.730 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2024-12-31 18:24:11.768 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=profile_credential_sharing 2024-12-31 18:24:11.769 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1735660800 2024-12-31 18:24:11.769 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:11.770 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1735660800 values less than (1735660800)) 2024-12-31 18:24:12.098 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:12.099 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2024-12-31 18:24:12.135 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=profile_credential_sharing 2024-12-31 18:24:12.136 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1735747200 2024-12-31 18:24:12.137 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:12.137 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1735747200 values less than (1735747200)) 2024-12-31 18:24:12.445 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:12.446 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2024-12-31 18:24:12.489 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=profile_credential_sharing 2024-12-31 18:24:12.490 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=profile_credential_sharing, partition=p1735833600 2024-12-31 18:24:12.490 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:12.491 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `profile_credential_sharing` add partition(partition p1735833600 values less than (1735833600)) 2024-12-31 18:24:12.554 WARN 34018 --- [ocp-async-7,c32d42806128c24a,8c0522d1b02117f2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:12.554 INFO 34018 --- [ocp-async-8,fff742ef9df1bec5,fc6c57f5f2e45606] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:12.568 INFO 34018 --- [prometheus-minute-schedule-1,91a4458d8c330c2d,0ff07589de46d6ae] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:12.569 INFO 34018 --- [prometheus-hour-schedule-1,5a117c71ba7e824a,5cedc4906117b034] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:24:12.647 INFO 34018 --- [metric-archive-second-28,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640580, nodeCount=6, affectRows=6 2024-12-31 18:24:12.648 INFO 34018 --- [metric-archive-second-28,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640580, nodeCount=6, validCount=6 2024-12-31 18:24:12.651 INFO 34018 --- [metric-archive-second-17,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640580, nodeCount=55, affectRows=55 2024-12-31 18:24:12.651 INFO 34018 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640580, nodeCount=44, affectRows=44 2024-12-31 18:24:12.651 INFO 34018 --- [metric-archive-second-27,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640580, nodeCount=12, affectRows=12 2024-12-31 18:24:12.651 INFO 34018 --- [metric-archive-second-10,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640580, nodeCount=7, affectRows=7 2024-12-31 18:24:12.651 INFO 34018 --- [metric-archive-second-9,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640580, nodeCount=15, affectRows=15 2024-12-31 18:24:12.651 INFO 34018 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640580, nodeCount=30, affectRows=30 2024-12-31 18:24:12.651 INFO 34018 --- [metric-archive-second-31,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640580, nodeCount=36, affectRows=36 2024-12-31 18:24:12.651 INFO 34018 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640580, nodeCount=40, affectRows=40 2024-12-31 18:24:12.651 INFO 34018 --- [metric-archive-second-30,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640580, nodeCount=36, affectRows=36 2024-12-31 18:24:12.651 INFO 34018 --- [metric-archive-second-10,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640580, nodeCount=7, validCount=7 2024-12-31 18:24:12.652 INFO 34018 --- [metric-archive-second-9,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640580, nodeCount=15, validCount=15 2024-12-31 18:24:12.652 INFO 34018 --- [metric-archive-second-27,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640580, nodeCount=12, validCount=12 2024-12-31 18:24:12.652 INFO 34018 --- [metric-archive-second-31,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640580, nodeCount=36, validCount=36 2024-12-31 18:24:12.652 INFO 34018 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640580, nodeCount=30, validCount=30 2024-12-31 18:24:12.652 INFO 34018 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640580, nodeCount=40, validCount=40 2024-12-31 18:24:12.653 INFO 34018 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640580, nodeCount=44, validCount=44 2024-12-31 18:24:12.652 INFO 34018 --- [metric-archive-second-30,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640580, nodeCount=36, validCount=36 2024-12-31 18:24:12.653 INFO 34018 --- [metric-archive-second-17,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640580, nodeCount=55, validCount=55 2024-12-31 18:24:12.707 INFO 34018 --- [metric-archive-second-24,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640580, nodeCount=68, affectRows=68 2024-12-31 18:24:12.708 INFO 34018 --- [metric-archive-second-24,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640580, nodeCount=67, validCount=67 2024-12-31 18:24:12.801 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:12.802 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='profile_credential_sharing' and table_type='BASE TABLE' 2024-12-31 18:24:12.841 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=profile_credential_sharing 2024-12-31 18:24:12.842 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:12.843 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:24:12.843 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:12.843 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_cache_info 2024-12-31 18:24:12.857 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=ocp_cache_info, partition=p1735056000 2024-12-31 18:24:12.857 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:12.858 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_cache_info` add partition(partition p1735056000 values less than (1735056000)) 2024-12-31 18:24:12.992 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:12.994 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:13.137 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:13.139 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='ocp_cache_info' and table_type='BASE TABLE' 2024-12-31 18:24:13.177 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=ocp_cache_info 2024-12-31 18:24:13.178 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=ocp_cache_info, partition=p1735142400 2024-12-31 18:24:13.178 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:13.179 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_cache_info` add partition(partition p1735142400 values less than (1735142400)) 2024-12-31 18:24:13.507 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:13.508 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='ocp_cache_info' and table_type='BASE TABLE' 2024-12-31 18:24:13.541 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=ocp_cache_info 2024-12-31 18:24:13.542 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=ocp_cache_info, partition=p1735228800 2024-12-31 18:24:13.542 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:13.542 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_cache_info` add partition(partition p1735228800 values less than (1735228800)) 2024-12-31 18:24:13.849 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:13.850 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='ocp_cache_info' and table_type='BASE TABLE' 2024-12-31 18:24:13.882 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=ocp_cache_info 2024-12-31 18:24:13.883 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=ocp_cache_info, partition=p1735315200 2024-12-31 18:24:13.884 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:13.884 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_cache_info` add partition(partition p1735315200 values less than (1735315200)) 2024-12-31 18:24:14.185 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:14.187 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='ocp_cache_info' and table_type='BASE TABLE' 2024-12-31 18:24:14.224 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=ocp_cache_info 2024-12-31 18:24:14.225 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=ocp_cache_info, partition=p1735401600 2024-12-31 18:24:14.225 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:14.226 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_cache_info` add partition(partition p1735401600 values less than (1735401600)) 2024-12-31 18:24:14.554 WARN 34018 --- [ocp-async-2,a7ceda979d7b0d20,07beb6c02e6ae24f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:14.554 INFO 34018 --- [ocp-async-5,7f414bc7a0cd97d2,418b952b6ecf5e60] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:14.615 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:14.616 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='ocp_cache_info' and table_type='BASE TABLE' 2024-12-31 18:24:14.659 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=ocp_cache_info 2024-12-31 18:24:14.660 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=ocp_cache_info, partition=p1735488000 2024-12-31 18:24:14.660 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:14.661 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_cache_info` add partition(partition p1735488000 values less than (1735488000)) 2024-12-31 18:24:14.972 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:14.973 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='ocp_cache_info' and table_type='BASE TABLE' 2024-12-31 18:24:15.013 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=ocp_cache_info 2024-12-31 18:24:15.014 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=ocp_cache_info, partition=p1735574400 2024-12-31 18:24:15.014 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:15.015 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_cache_info` add partition(partition p1735574400 values less than (1735574400)) 2024-12-31 18:24:15.305 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:15.306 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='ocp_cache_info' and table_type='BASE TABLE' 2024-12-31 18:24:15.344 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=ocp_cache_info 2024-12-31 18:24:15.345 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=ocp_cache_info, partition=p1735660800 2024-12-31 18:24:15.345 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:15.346 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_cache_info` add partition(partition p1735660800 values less than (1735660800)) 2024-12-31 18:24:15.568 INFO 34018 --- [prometheus-minute-schedule-1,7ce7ff3f50819eaa,ecf4612cdbffe691] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:15.739 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:15.741 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='ocp_cache_info' and table_type='BASE TABLE' 2024-12-31 18:24:15.779 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=ocp_cache_info 2024-12-31 18:24:15.780 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=ocp_cache_info, partition=p1735747200 2024-12-31 18:24:15.781 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:15.781 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_cache_info` add partition(partition p1735747200 values less than (1735747200)) 2024-12-31 18:24:15.994 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:15.996 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:16.098 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:16.099 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='ocp_cache_info' and table_type='BASE TABLE' 2024-12-31 18:24:16.140 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=ocp_cache_info 2024-12-31 18:24:16.141 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167014] Creating partition, scope=Metadb, table=ocp_cache_info, partition=p1735833600 2024-12-31 18:24:16.142 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:16.142 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: alter table `ocp_cache_info` add partition(partition p1735833600 values less than (1735833600)) 2024-12-31 18:24:16.455 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:24:16.457 INFO 34018 --- [part-initial-worker,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select table_schema databaseName, table_name tableName, create_time gmtCreate from information_schema.tables where table_schema='meta_database' and table_name='ocp_cache_info' and table_type='BASE TABLE' 2024-12-31 18:24:16.498 INFO 34018 --- [part-initial-worker,,] c.o.o.alarm.service.OcpAlarmServiceImpl : alarm can not be resoled because alarm target is not found, alarmType=partition_create_failed, target=alarm_template_id=0:datasource=Metadb:table_name=ocp_cache_info 2024-12-31 18:24:16.499 INFO 34018 --- [part-initial-worker,,] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Metadb 2024-12-31 18:24:16.555 WARN 34018 --- [ocp-async-1,639cc381de831643,45f67c278273fd46] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:16.555 INFO 34018 --- [ocp-async-4,f90dc54576bd8bca,1f2f059c2e6e5ea4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:18.457 INFO 34018 --- [ocp-schedules-29,41f38ad35e3bc84a,de8b6c25e83b5a0f] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:24:18.458 INFO 34018 --- [ocp-schedules-8,ae23ffcf77027969,59f1624abedadbba] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:24:18.458 INFO 34018 --- [ocp-schedules-9,ab30099c9cf238fd,a88bd58a34b606cf] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:24:18.459 INFO 34018 --- [ocp-schedules-13,3e77deb907c32063,f2ed4c23a23ec5dd] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:24:18.471 INFO 34018 --- [ocp-schedules-5,c2a6861a4a64908f,b89627e5d637a411] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:24:18.471 INFO 34018 --- [ocp-schedules-5,c2a6861a4a64908f,b89627e5d637a411] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:24:18.471 INFO 34018 --- [ocp-schedules-18,ca5be5ad04824f0a,5adfce0214f2ecbd] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:24:18.471 INFO 34018 --- [ocp-schedules-18,ca5be5ad04824f0a,5adfce0214f2ecbd] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:24:18.472 INFO 34018 --- [ocp-schedules-25,c6e3b9496173b797,e73980917b8d9c33] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:24:18.472 INFO 34018 --- [ocp-schedules-25,c6e3b9496173b797,e73980917b8d9c33] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:24:18.491 INFO 34018 --- [ocp-async-6,82143765e556e65a,fe5209c7335c095f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:24:18.513 INFO 34018 --- [ocp-schedules-26,bb30560254e9fe1d,bcbc4ca00aa8e724] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:24:18.543 INFO 34018 --- [ocp-schedules-11,7c9070fb7db38368,a4aa7718b89d70fe] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:24:18.554 INFO 34018 --- [ocp-schedules-19,2b6d03aec07df284,053b21d14482f5cc] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:24:18.555 WARN 34018 --- [ocp-async-3,48c63f990403dd67,b5e580399420178e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:18.555 INFO 34018 --- [ocp-async-8,3aec5ecb1cfaf81d,6e4bcc4b644f8702] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:18.568 INFO 34018 --- [prometheus-minute-schedule-1,ef02175633c0c69b,196bcfbce2699068] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:18.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:24:18.589196+08:00, lastProcessTime=2024-12-31T18:24:08.588277+08:00 2024-12-31 18:24:18.761 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:24:18.589196+08:00 2024-12-31 18:24:18.996 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:18.998 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:20.258 INFO 34018 --- [ocp-schedules-3,2cbd5d4150d0c4f6,c3a1b9cd5996ae80] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:24:20.555 WARN 34018 --- [ocp-async-8,fcf87b04ccc4cd15,97429b943e7033c0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:20.555 INFO 34018 --- [ocp-async-5,c6e395ef126994c7,e78f0f806b884d53] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:21.568 INFO 34018 --- [prometheus-minute-schedule-1,dce26924da103b2e,c25f5d45cb9c4bb6] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:21.998 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:22.000 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:22.555 WARN 34018 --- [ocp-async-9,1f76bc2f93f713f6,74e721be13d8cb8e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:22.555 INFO 34018 --- [ocp-async-5,8111908fd3e80ac1,a1ec3b06f9ff5bdb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:24.555 INFO 34018 --- [ocp-async-5,1f54b210da732f71,5dac572544d48930] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:24.555 WARN 34018 --- [ocp-async-2,db98f0172a8b68da,be18e3c1fbb963b8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:24.568 INFO 34018 --- [prometheus-minute-schedule-1,c57b51c657b42667,8a0db1ba56728d1e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:25.000 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:25.002 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:26.556 WARN 34018 --- [ocp-async-8,8744d188c02b749d,f35388132413255d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:26.556 INFO 34018 --- [ocp-async-6,3554cbb900cac64f,9330f30ac865f22b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:27.568 INFO 34018 --- [prometheus-minute-schedule-1,b411aeddabe1ed91,95acb787d0d4e4b8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:28.002 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:28.004 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:28.491 INFO 34018 --- [ocp-async-5,f83d1ea6549e789a,d2f3c54c3b63be3b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:24:28.513 INFO 34018 --- [ocp-schedules-11,35de2b1acc11d97c,5f40884dc8d70783] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:24:28.556 WARN 34018 --- [ocp-async-6,74c3f9d40b70510c,63f9a3e1ea174e9b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:28.556 INFO 34018 --- [ocp-async-6,2be2e6e203ff34c1,851266a3941fddda] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:28.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:24:28.588709+08:00, lastProcessTime=2024-12-31T18:24:18.589196+08:00 2024-12-31 18:24:28.764 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:24:28.588709+08:00 2024-12-31 18:24:29.013 INFO 34018 --- [ocp-schedules-2,850b80cf3cb7b371,4d46bdf9cb805352] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:24:29.022 INFO 34018 --- [ocp-schedules-2,850b80cf3cb7b371,4d46bdf9cb805352] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:24:29.022 INFO 34018 --- [ocp-schedules-2,850b80cf3cb7b371,4d46bdf9cb805352] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:24:30.309 INFO 34018 --- [ocp-schedules-10,f90dc3302bd9976c,de0c44110385b179] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:24:30.556 WARN 34018 --- [ocp-async-2,1d8f6d3d23fb0fd1,ff06ffe1362cef0f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:30.556 INFO 34018 --- [ocp-async-2,5f8c7109d55def9b,94155441301d3949] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:30.568 INFO 34018 --- [prometheus-minute-schedule-1,9c5bbdb3ecb37f2f,452bcb10b8a9de1d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:31.004 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:31.006 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:32.556 WARN 34018 --- [ocp-async-2,367e5f9df68ebe4c,eba21ac9b3957a0e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:32.556 INFO 34018 --- [ocp-async-10,0ed2b0af45d064ce,9a1e86f44dc2aadd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:33.568 INFO 34018 --- [prometheus-minute-schedule-1,c1bfb3e3c42951ee,5a585b0a74b35bfb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:34.006 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:34.008 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:34.556 WARN 34018 --- [ocp-async-9,cb79862a4635cf03,fb0c8d2097747fdb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:34.556 INFO 34018 --- [ocp-async-7,8ac8ec754c755e50,d7095f2d4e82c0fc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:36.557 WARN 34018 --- [ocp-async-6,c1db7165e8b901bc,2f1779d76a455b1b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:36.557 INFO 34018 --- [ocp-async-4,cd73e78ac02ed84c,9496e7c988bb6823] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:36.568 INFO 34018 --- [prometheus-minute-schedule-1,8299ec04e40438ae,cbdd86d202c5e7a1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:36.569 INFO 34018 --- [prometheus-cache-monitor1,3cf85715937c2dd3,ec65edafba3a49f2] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1047,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":349,"seriesIdKeySize":349,"secondWriteQueue":0,"minuteWriteCacheSize":348} 2024-12-31 18:24:36.569 INFO 34018 --- [prometheus-cache-monitor1,3cf85715937c2dd3,ec65edafba3a49f2] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=33, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=33, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:24:36.594 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2024-12-31T18:20:36.513, end=2024-12-31T18:22:36.59} 2024-12-31 18:24:36.603 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [] 2024-12-31 18:24:36.603 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2024-12-31 18:24:37.008 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:37.010 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:38.491 INFO 34018 --- [ocp-async-8,d68a1fddf3bf1c75,e5720169ccea26ec] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:24:38.514 INFO 34018 --- [ocp-schedules-9,3206d180afbfb91c,fd295d4faea0cb3c] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:24:38.557 WARN 34018 --- [ocp-async-2,2563a6fd70dec06e,73078d29074d3d8d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:38.557 INFO 34018 --- [ocp-async-1,c1a0c494987e69ba,61997b8681a8fd78] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:38.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:24:38.588441+08:00, lastProcessTime=2024-12-31T18:24:28.588709+08:00 2024-12-31 18:24:38.742 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:24:38.588441+08:00 2024-12-31 18:24:39.568 INFO 34018 --- [prometheus-minute-schedule-1,2aa1e80c4709e545,db6db1a80f08918e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:40.003 INFO 34018 --- [ocp-schedules-6,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:24:40.004 INFO 34018 --- [ocp-schedules-17,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:24:40.010 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:40.011 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:40.362 INFO 34018 --- [ocp-schedules-4,c7ecd7a1d22db4aa,bd0e1da1624e8a10] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:24:40.559 WARN 34018 --- [ocp-async-5,ca42d0942117bc31,bf31f563c0dfe210] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:40.559 INFO 34018 --- [ocp-async-1,ce6eb1386ea6d183,634b647fe0b07f57] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:42.559 WARN 34018 --- [ocp-async-1,8046f35a9728c42b,016f1a07a1167a4d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:42.559 INFO 34018 --- [ocp-async-7,820f977eecf89ff1,8675fb2a67d078e5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:42.568 INFO 34018 --- [prometheus-minute-schedule-1,f8f12a39edf68363,0fb86fdc556d8e9f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:43.012 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:43.014 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:44.559 WARN 34018 --- [ocp-async-9,ed0c019416f77b3a,f617f548270d7e6d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:44.559 INFO 34018 --- [ocp-async-7,b8eebb63a9b0f747,c5c574ed91f25c43] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:45.568 INFO 34018 --- [prometheus-minute-schedule-1,e5095236c4287775,a4754d3682e3fd29] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:46.014 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:46.016 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:46.560 WARN 34018 --- [ocp-async-5,b1ba545a77cd6eec,e5d8d5ff82cd1531] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:46.560 INFO 34018 --- [ocp-async-3,10fe033a2e7410b6,3979fb336b15f18e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:48.456 INFO 34018 --- [ocp-schedules-2,0ceffb51bd2d00f7,7b2d54e76f3f5caa] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:24:48.457 INFO 34018 --- [ocp-schedules-30,e7b21c1114c8c5bd,078fd93cc557356d] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:24:48.458 INFO 34018 --- [ocp-schedules-6,0a1d4a18f45ff950,56b1d6298502a907] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:24:48.458 INFO 34018 --- [ocp-schedules-16,875f54645bcc1a4f,ac4395ed0483053b] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:24:48.459 INFO 34018 --- [ocp-schedules-29,b3dbe6be34dfa1e1,026b9b3a3408af15] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:24:48.459 INFO 34018 --- [ocp-schedules-28,b8b50e8fae45266b,3e227bbe65c0c11c] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:24:48.464 INFO 34018 --- [ocp-schedules-20,2bd5dc4db683b5b0,f7c74ad0785eafd1] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:24:48.465 INFO 34018 --- [ocp-schedules-2,0ceffb51bd2d00f7,7b2d54e76f3f5caa] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:24:48.465 INFO 34018 --- [ocp-schedules-7,cb427fc9ad0c7635,e3fc0602d3ac4c87] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster root server. 2024-12-31 18:24:48.472 INFO 34018 --- [ocp-schedules-28,b8b50e8fae45266b,3e227bbe65c0c11c] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:24:48.473 INFO 34018 --- [ocp-schedules-11,65f91bc9309dff43,ccf9a7435b1c2abb] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:24:48.473 INFO 34018 --- [ocp-schedules-13,6157a80649b28e5b,59252d8ffa964895] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:24:48.473 INFO 34018 --- [ocp-schedules-11,65f91bc9309dff43,ccf9a7435b1c2abb] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:24:48.473 INFO 34018 --- [ocp-schedules-13,6157a80649b28e5b,59252d8ffa964895] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:24:48.475 INFO 34018 --- [ocp-schedules-8,ce2a7ff4ea74c0d2,d60fea6b7008ff75] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:24:48.475 INFO 34018 --- [ocp-schedules-8,ce2a7ff4ea74c0d2,d60fea6b7008ff75] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:24:48.492 INFO 34018 --- [ocp-async-1,c178e9bd8b9ce38c,55f26e8769fba0b7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:24:48.498 INFO 34018 --- [ocp-schedules-12,c0d0855e0aa676f3,1e0f887f002d728c] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: hostQueryCache 2024-12-31 18:24:48.498 INFO 34018 --- [ocp-schedules-12,c0d0855e0aa676f3,1e0f887f002d728c] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2024-12-31 18:24:48.507 INFO 34018 --- [ocp-schedules-12,c0d0855e0aa676f3,1e0f887f002d728c] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2024-12-31 18:24:48.507 INFO 34018 --- [ocp-schedules-12,c0d0855e0aa676f3,1e0f887f002d728c] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obQueryCache 2024-12-31 18:24:48.507 INFO 34018 --- [ocp-schedules-12,c0d0855e0aa676f3,1e0f887f002d728c] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2024-12-31 18:24:48.514 INFO 34018 --- [ocp-schedules-21,208d0244c2245f7a,5eb13049932c126d] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:24:48.517 INFO 34018 --- [ocp-schedules-15,2c38afe6bf8ad18a,bf4dd3374f0f3c19] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper 2024-12-31 18:24:48.517 INFO 34018 --- [ocp-schedules-12,c0d0855e0aa676f3,1e0f887f002d728c] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2024-12-31 18:24:48.517 INFO 34018 --- [ocp-schedules-12,c0d0855e0aa676f3,1e0f887f002d728c] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obProxyQueryCache 2024-12-31 18:24:48.517 INFO 34018 --- [ocp-schedules-12,c0d0855e0aa676f3,1e0f887f002d728c] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2024-12-31 18:24:48.518 INFO 34018 --- [ocp-schedules-27,fcec5b70ac7b17f1,4a7e9014f73bbecd] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant mini compaction 2024-12-31 18:24:48.518 INFO 34018 --- [ocp-schedules-27,fcec5b70ac7b17f1,4a7e9014f73bbecd] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2024-12-31 18:24:48.519 INFO 34018 --- [ocp-schedules-22,0ac31c42cd59c44b,c878874c882933ad] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[] 2024-12-31 18:24:48.519 INFO 34018 --- [ocp-schedules-22,0ac31c42cd59c44b,c878874c882933ad] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2024-12-31 18:24:48.521 INFO 34018 --- [ocp-schedules-27,fcec5b70ac7b17f1,4a7e9014f73bbecd] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2024-12-31 18:24:48.522 INFO 34018 --- [ocp-schedules-12,c0d0855e0aa676f3,1e0f887f002d728c] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2024-12-31 18:24:48.525 INFO 34018 --- [ocp-schedules-6,128a08184a9faee4,bf724b1596c2e0b0] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:24:48.526 INFO 34018 --- [ocp-schedules-16,dc47f9d665028a33,7d0deaf17cb77cfe] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:24:48.533 INFO 34018 --- [ocp-schedules-30,cfaaa882520a9ef2,28d168737574485b] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:24:48.533+08:00, clusters=[] 2024-12-31 18:24:48.535 INFO 34018 --- [ocp-schedules-7,cfab22ededbb69cc,d58601c0add4c44d] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:24:48.535 INFO 34018 --- [ocp-schedules-7,cfab22ededbb69cc,d58601c0add4c44d] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:24:48.535 INFO 34018 --- [ocp-schedules-20,2ddca98eee20c130,7e230341f5dad1be] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:24:48.536 INFO 34018 --- [ocp-schedules-29,66e6423d12b1d8db,aa082c8b1ea143fd] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:24:48.536+08:00, clusters=[] 2024-12-31 18:24:48.537 INFO 34018 --- [ocp-schedules-7,cfab22ededbb69cc,d58601c0add4c44d] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:24:48.537 INFO 34018 --- [ocp-schedules-7,cfab22ededbb69cc,d58601c0add4c44d] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:24:48.542 INFO 34018 --- [ocp-schedules-28,fc2ec26e6db0b6d4,26678cccf0fdf5a7] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:24:48.542 INFO 34018 --- [ocp-schedules-28,fc2ec26e6db0b6d4,26678cccf0fdf5a7] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:24:48.544 INFO 34018 --- [ocp-schedules-14,631797f787e0d4ee,61bfc425d133016a] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:24:48.547 INFO 34018 --- [ocp-schedules-11,5e4888a20475647e,acf6f948f2badb34] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:24:48.560 WARN 34018 --- [ocp-async-9,ad94502eeed925b6,e657b814cdee4daa] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:48.560 INFO 34018 --- [ocp-async-2,b3eea29104ffcf2a,9f00a54e903f503a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:48.566 INFO 34018 --- [ocp-schedules-23,d9d27ca3cb202078,229da5164594d48a] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:24:48.568 INFO 34018 --- [prometheus-minute-schedule-1,7ca83005759ec11d,9b6b2e87eac3da78] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:48.571 INFO 34018 --- [ocp-schedules-23,d9d27ca3cb202078,229da5164594d48a] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:24:48.571 INFO 34018 --- [ocp-schedules-23,d9d27ca3cb202078,229da5164594d48a] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 0 2024-12-31 18:24:48.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:24:48.588505+08:00, lastProcessTime=2024-12-31T18:24:38.588441+08:00 2024-12-31 18:24:48.628 INFO 34018 --- [ocp-schedules-5,371e283ec60bc107,9017a448f82f27d7] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:24:48.628 INFO 34018 --- [ocp-schedules-5,371e283ec60bc107,9017a448f82f27d7] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:24:48.630 INFO 34018 --- [ocp-schedules-5,371e283ec60bc107,9017a448f82f27d7] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:24:48.630 INFO 34018 --- [ocp-schedules-5,371e283ec60bc107,9017a448f82f27d7] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:24:48.631 INFO 34018 --- [ocp-schedules-5,371e283ec60bc107,9017a448f82f27d7] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:24:48.631 INFO 34018 --- [ocp-schedules-5,371e283ec60bc107,9017a448f82f27d7] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730651867074035712 2024-12-31 18:24:48.761 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:24:48.588505+08:00 2024-12-31 18:24:49.016 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:49.018 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:49.027 INFO 34018 --- [ocp-schedules-24,94143cfd3826290a,8560d4d866244274] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:24:49.037 INFO 34018 --- [ocp-schedules-24,94143cfd3826290a,8560d4d866244274] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:24:49.037 INFO 34018 --- [ocp-schedules-24,94143cfd3826290a,8560d4d866244274] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:24:50.401 INFO 34018 --- [ocp-schedules-3,09248be367049c79,231311f6c357a46b] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:24:50.560 WARN 34018 --- [ocp-async-10,4131c7ba15f12345,1724f4311159f4f2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:50.560 INFO 34018 --- [ocp-async-7,46e0033bf686a92f,6112ce978fe0ce9e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:51.568 INFO 34018 --- [prometheus-minute-schedule-1,0540310274ec9162,3464b3f7b9c16ff8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:51.889 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:24:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:24:52.018 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:52.020 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:52.560 WARN 34018 --- [ocp-async-6,4e151304229cb7d4,624168961b3efa2e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:52.560 INFO 34018 --- [ocp-async-1,00a5eaee237130f9,69b32f88fe397a35] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:54.560 WARN 34018 --- [ocp-async-9,128cfa7e8014e1ce,f5ab5e8050d0f722] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:54.560 INFO 34018 --- [ocp-async-4,7d92cacd23e1bf41,eedb014a365deb1c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:54.568 INFO 34018 --- [prometheus-minute-schedule-1,2df56ae7e478fc69,23073c03cba45177] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:55.020 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:55.022 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:56.560 WARN 34018 --- [ocp-async-10,7228442dee27b339,865fb5509cb6877e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:56.561 INFO 34018 --- [ocp-async-5,8e6526b1f923add9,90f55f2a27db7445] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:57.568 INFO 34018 --- [prometheus-minute-schedule-1,1628e9eadcb06fd2,83df940521aa64dd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640700, interval=60 2024-12-31 18:24:58.022 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:24:58.024 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:24:58.492 INFO 34018 --- [ocp-async-7,a0578c3c6b38d231,cb8f7c77d32a6537] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:24:58.514 INFO 34018 --- [ocp-schedules-10,42008dc20a4bc44c,9b38acd31bf08e53] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:24:58.561 WARN 34018 --- [ocp-async-9,422584c74e285560,bc15e163de603899] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:24:58.561 INFO 34018 --- [ocp-async-1,9a18b178da473b0a,c64b04c215ec3d7e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:24:58.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:24:58.589404+08:00, lastProcessTime=2024-12-31T18:24:48.588505+08:00 2024-12-31 18:24:58.761 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:24:58.589404+08:00 2024-12-31 18:25:00.456 INFO 34018 --- [ocp-schedules-27,36facb8a0ec9a941,635ce641385a1878] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:25:00.561 WARN 34018 --- [ocp-async-10,be8e8f240352d90d,ea8133fba516210b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:00.561 INFO 34018 --- [ocp-async-4,9df15cc5ab496a44,b2a817b8cf62ef85] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:00.568 INFO 34018 --- [prometheus-minute-schedule-1,3729b102c04c389c,f1d7363e7358634b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:00.930 INFO 34018 --- [task-coordinator2,93cfe403787200b1,d1bc35a2a8818675] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-12-31 18:20:01.0, nextRun=2024-12-31 18:25:00.0, currentDate=Tue Dec 31 18:25:00 CST 2024 2024-12-31 18:25:00.930 INFO 34018 --- [task-coordinator2,93cfe403787200b1,d1bc35a2a8818675] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999985, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2024-12-31 18:20:01.0, nextRunTime=2024-12-31 18:25:00.0} 2024-12-31 18:25:00.938 INFO 34018 --- [task-coordinator2,93cfe403787200b1,d1bc35a2a8818675] c.o.o.p.s.internal.SqlParseTaskSchedule : get Clusters for parse:[] 2024-12-31 18:25:00.943 INFO 34018 --- [task-coordinator2,93cfe403787200b1,d1bc35a2a8818675] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2024-12-31 18:25:00.943 INFO 34018 --- [task-coordinator2,93cfe403787200b1,d1bc35a2a8818675] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2024-12-31 18:25:01.024 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:01.026 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:02.561 WARN 34018 --- [ocp-async-5,1a2b388204b4a97b,0af7098633e7ee4c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:02.561 INFO 34018 --- [ocp-async-7,5dba2e48c5ebb849,8a902b5f3e0c180b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:03.568 INFO 34018 --- [prometheus-minute-schedule-1,281fba1c8895b984,912bd589b72f482d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:04.026 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:04.028 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:04.561 WARN 34018 --- [ocp-async-3,bf009fbfd56ae583,e56a98006042bfef] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:04.561 INFO 34018 --- [ocp-async-9,f5b87796f40ec137,77d3d1f49d88f5ad] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:06.561 WARN 34018 --- [ocp-async-10,e8f2b49deae293e2,9a0aa31eb89cefa4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:06.562 INFO 34018 --- [ocp-async-8,4d7b05754596c6b7,8526e6c7e665addc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:06.568 INFO 34018 --- [prometheus-minute-schedule-1,f4c58f353f3e1a17,29047bac1a6966cd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:07.028 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:07.030 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:08.492 INFO 34018 --- [ocp-async-8,b406f911aba4d870,fab2d1d5392c3f61] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:25:08.514 INFO 34018 --- [ocp-schedules-23,d29eaeb93d48b280,8f6cf561161582c3] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:25:08.562 WARN 34018 --- [ocp-async-2,24b0e844ef551a46,3860fa4bbfb347bb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:08.562 INFO 34018 --- [ocp-async-7,b89a7c3cd0b9d19a,365f139682340158] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:08.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:25:08.588750+08:00, lastProcessTime=2024-12-31T18:24:58.589404+08:00 2024-12-31 18:25:08.753 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:25:08.588750+08:00 2024-12-31 18:25:09.041 INFO 34018 --- [ocp-schedules-24,59116c18839ae8ba,647199768ab0cf0c] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:25:09.054 INFO 34018 --- [ocp-schedules-24,59116c18839ae8ba,647199768ab0cf0c] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:25:09.054 INFO 34018 --- [ocp-schedules-24,59116c18839ae8ba,647199768ab0cf0c] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:25:09.568 INFO 34018 --- [prometheus-minute-schedule-1,249ae47035d4ace3,81593ef1267142ca] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:10.003 INFO 34018 --- [ocp-schedules-28,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:25:10.003 INFO 34018 --- [ocp-schedules-1,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:25:10.030 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:10.032 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:10.496 INFO 34018 --- [ocp-schedules-30,e6754c50c805d710,d23fd845548fd75b] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:25:10.562 WARN 34018 --- [ocp-async-6,3a600657457d2af4,dcc3da536648746d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:10.562 INFO 34018 --- [ocp-async-9,2cd82d686ae3807e,0083517f489a189f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:10.889 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-12-31 18:25:10.908 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-12-31 18:25:12.562 WARN 34018 --- [ocp-async-9,2f703fbcd03c8803,94fbf8e23df85852] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:12.562 INFO 34018 --- [ocp-async-1,bd63b51b08ff0bde,a5851b390825a723] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:12.568 INFO 34018 --- [prometheus-minute-schedule-1,8f27c37461f3132b,56ebf93f52af37de] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:12.569 INFO 34018 --- [prometheus-hour-schedule-1,78cc41726855904f,c11e2c279a81e7d7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:25:12.642 INFO 34018 --- [metric-archive-second-29,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640640, nodeCount=349, affectRows=349 2024-12-31 18:25:12.645 INFO 34018 --- [metric-archive-second-29,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640640, nodeCount=348, validCount=348 2024-12-31 18:25:13.032 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:13.034 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:14.562 WARN 34018 --- [ocp-async-4,adb23c37d198dfea,0ccf3acb92b83738] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:14.563 INFO 34018 --- [ocp-async-2,9da6de1ce721edc5,bb8a9070dd26a349] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:15.568 INFO 34018 --- [prometheus-minute-schedule-1,bf3337f9e76d09c3,325d94c443d3cf0b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:16.034 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:16.036 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:16.562 WARN 34018 --- [ocp-async-2,275f7789cd68b6ef,b7c0ef58e105548d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:16.563 INFO 34018 --- [ocp-async-6,23a954f8555e6c13,2b3214727a086b35] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:16.662 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,20c233f8a88ade94,203a082762f3dab1] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=20c233f8a88ade94, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:25:16.662 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,deab41494d047910,4bf63affea703511] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=deab41494d047910, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:25:16.662 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,f82e8f6e711a192f,3bd40c08f70d4c32] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=f82e8f6e711a192f, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:25:16.663 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,c0f2f294ed77cf0f,649d04697e2b5297] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=c0f2f294ed77cf0f, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:25:16.663 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,f82e8f6e711a192f,3bd40c08f70d4c32] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=f82e8f6e711a192f, duration=12 ms] 2024-12-31 18:25:16.663 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,deab41494d047910,4bf63affea703511] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=deab41494d047910, duration=14 ms] 2024-12-31 18:25:16.663 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,c0f2f294ed77cf0f,649d04697e2b5297] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=c0f2f294ed77cf0f, duration=7 ms] 2024-12-31 18:25:16.667 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,20c233f8a88ade94,203a082762f3dab1] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=20c233f8a88ade94, duration=21 ms] 2024-12-31 18:25:18.457 INFO 34018 --- [ocp-schedules-21,861c0c1bee588c1e,da4984aad69fdbe5] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:25:18.458 INFO 34018 --- [ocp-schedules-26,78334a17799c7ad3,85a3db61594fa139] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:25:18.458 INFO 34018 --- [ocp-schedules-16,a03153b511819d0f,c48a2d5ffd55ded7] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:25:18.458 INFO 34018 --- [ocp-schedules-6,d620aa050925b672,4acdbb34278a91ba] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:25:18.468 INFO 34018 --- [ocp-schedules-1,057bec133359364e,54a6566e24e44621] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:25:18.471 INFO 34018 --- [ocp-schedules-8,5f582fe654e7532f,88b2cb35b1ffc545] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:25:18.471 INFO 34018 --- [ocp-schedules-8,5f582fe654e7532f,88b2cb35b1ffc545] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:25:18.471 INFO 34018 --- [ocp-schedules-25,724178181f6562a5,d2cf4a1a204a62c7] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:25:18.471 INFO 34018 --- [ocp-schedules-25,724178181f6562a5,d2cf4a1a204a62c7] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:25:18.473 INFO 34018 --- [ocp-schedules-11,064fa7a2b75a9765,efa029cb779880cd] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:25:18.475 INFO 34018 --- [ocp-schedules-11,064fa7a2b75a9765,efa029cb779880cd] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:25:18.492 INFO 34018 --- [ocp-async-6,eaa9c82d3dfc842c,206ce53869aceb63] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:25:18.514 INFO 34018 --- [ocp-schedules-20,63d0940406da3cfa,bf7c912f4196759a] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:25:18.547 INFO 34018 --- [ocp-schedules-14,b3d0e747d2b27284,c6702d686139add8] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:25:18.563 WARN 34018 --- [ocp-async-9,4939a0e6054fc71a,82dd94ab9d496d1d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:18.563 INFO 34018 --- [ocp-async-10,4fd387f5c320da6a,1d3ffdc147d9f8c0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:18.568 INFO 34018 --- [prometheus-minute-schedule-1,9ee0b2598a7e00a8,9854bf119fc07a09] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:18.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:25:18.588585+08:00, lastProcessTime=2024-12-31T18:25:08.588750+08:00 2024-12-31 18:25:18.748 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:25:18.588585+08:00 2024-12-31 18:25:19.036 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:19.038 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:20.546 INFO 34018 --- [ocp-schedules-22,21eff30e079a03c4,261c3f8cd45afcf2] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:25:20.563 WARN 34018 --- [ocp-async-4,4be4d2f6be0dfac9,644428db808c093c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:20.563 INFO 34018 --- [ocp-async-5,9d0ba4c466154dda,142f9078586d8d87] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:21.568 INFO 34018 --- [prometheus-minute-schedule-1,242822792f74630a,04da0c35b569d7b6] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:22.038 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:22.041 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:22.563 WARN 34018 --- [ocp-async-7,c5c3e04fc6b3f07b,fd2d3d58693a5bad] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:22.563 INFO 34018 --- [ocp-async-3,13284acc11c76e36,ccdcaff83a5381d0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:24.563 WARN 34018 --- [ocp-async-8,4cef9da9fdb4b25b,f2aae1b4a3ff2b5e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:24.564 INFO 34018 --- [ocp-async-9,9eab704c19b66fdc,0a0d34260e7c2390] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:24.568 INFO 34018 --- [prometheus-minute-schedule-1,bcaf3ef51ac35c23,ac625db9f12d2525] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:25.041 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:25.042 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:26.564 WARN 34018 --- [ocp-async-4,bf71d4bfc15ad65b,9c83a2cff6fbf529] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:26.564 INFO 34018 --- [ocp-async-10,7a052ca6263e6c67,bd0d8a490dfa9b31] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:27.568 INFO 34018 --- [prometheus-minute-schedule-1,fcc3a322e1ef1e9a,417054e069ccd221] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:28.043 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:28.044 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:28.492 INFO 34018 --- [ocp-async-1,eb4f16d998bf561f,75a0c71e6e0b312f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:25:28.515 INFO 34018 --- [ocp-schedules-5,d77e870cdcb52584,21e4b3f2b60578d5] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:25:28.564 WARN 34018 --- [ocp-async-7,dc6a52a4f8d204c9,731859a3e30c16f8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:28.564 INFO 34018 --- [ocp-async-5,a1d48b36ca94a39d,c09c8a2393306d78] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:28.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:25:28.589007+08:00, lastProcessTime=2024-12-31T18:25:18.588585+08:00 2024-12-31 18:25:29.057 INFO 34018 --- [ocp-schedules-21,573d48e25b29ee1f,5e01e0f4c6a5a075] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:25:29.069 INFO 34018 --- [ocp-schedules-21,573d48e25b29ee1f,5e01e0f4c6a5a075] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:25:29.069 INFO 34018 --- [ocp-schedules-21,573d48e25b29ee1f,5e01e0f4c6a5a075] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:25:29.470 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:25:28.589007+08:00 2024-12-31 18:25:30.564 WARN 34018 --- [ocp-async-4,64f7b6f0c14a9e17,87804c7f0a6b711f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:30.564 INFO 34018 --- [ocp-async-9,12ea0ac4deb1fd43,968c982cba2a4344] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:30.568 INFO 34018 --- [prometheus-minute-schedule-1,f186e9c9fad99448,a0d4022836ec277c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:30.591 INFO 34018 --- [ocp-schedules-21,32fc56264cdba531,2f7bc345a40ce2ea] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:25:31.044 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:31.046 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:32.564 WARN 34018 --- [ocp-async-7,e8f16b185b77e79a,973cc3b68999e5ab] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:32.564 INFO 34018 --- [ocp-async-3,f0217c92e11256cb,9963e4cd476c5f35] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:33.568 INFO 34018 --- [prometheus-minute-schedule-1,1f8677562a21679c,ae4fb203c51e30ba] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:34.046 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:34.048 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:34.564 WARN 34018 --- [ocp-async-1,f607588ad015588f,3b22379f76b6ff05] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:34.564 INFO 34018 --- [ocp-async-8,24cacb7ce2b6e85b,d43b636f8c44ebf7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:36.446 INFO 34018 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2024-12-31T18:19:36.441, end=2024-12-31T18:24:36.441} 2024-12-31 18:25:36.446 INFO 34018 --- [pool-15-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2024-12-31T18:19:36.441, end=2024-12-31T18:24:36.441} 2024-12-31 18:25:36.451 INFO 34018 --- [pool-15-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER : for [] 2024-12-31 18:25:36.451 INFO 34018 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER : for [] 2024-12-31 18:25:36.452 INFO 34018 --- [pool-15-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2024-12-31 18:25:36.452 INFO 34018 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2024-12-31 18:25:36.565 WARN 34018 --- [ocp-async-7,bdd16bec8f95bcd7,d97cc3bba77f0156] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:36.565 INFO 34018 --- [ocp-async-10,e6273f35e719bf0f,2cf740381782555b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:36.568 INFO 34018 --- [prometheus-minute-schedule-1,efb4b78456ad461f,3e3bdba542e871b3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:36.569 INFO 34018 --- [prometheus-cache-monitor1,48a3dc4373f1c72c,eb348d30fdf13b14] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1396,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":349,"seriesIdKeySize":349,"secondWriteQueue":0,"minuteWriteCacheSize":348} 2024-12-31 18:25:36.569 INFO 34018 --- [prometheus-cache-monitor1,48a3dc4373f1c72c,eb348d30fdf13b14] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=33, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=33, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:25:36.575 WARN 34018 --- [ocp-async-10,e6273f35e719bf0f,2cf740381782555b] c.o.o.s.common.DistributedLockAspect : Acquire lock fail, another request is processing, key=AlarmEventProcessForSelfcure 2024-12-31 18:25:37.048 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:37.049 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:38.493 INFO 34018 --- [ocp-async-4,e589f1b19f05c7f4,ea2ebf4a0238c78b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:25:38.515 INFO 34018 --- [ocp-schedules-2,427a640d3af2b021,a8eea388410e7571] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:25:38.565 WARN 34018 --- [ocp-async-7,837098fe9421d7a6,89dd6840d4b29d3e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:38.565 INFO 34018 --- [ocp-async-9,fc9d1224caafbc9a,f9d3ac2f8fd9aa97] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:38.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:25:38.589319+08:00, lastProcessTime=2024-12-31T18:25:28.589007+08:00 2024-12-31 18:25:38.761 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:25:38.589319+08:00 2024-12-31 18:25:39.568 INFO 34018 --- [prometheus-minute-schedule-1,0df275df184539bc,fff73cac3e5acc7f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:40.004 INFO 34018 --- [ocp-schedules-1,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:25:40.004 INFO 34018 --- [ocp-schedules-29,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:25:40.050 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:40.052 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:40.565 WARN 34018 --- [ocp-async-8,7cac33ce27088563,d91d960f5fdd1e3a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:40.565 INFO 34018 --- [ocp-async-3,181989eed4ff4b39,5c4c776f0ee0901d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:40.647 INFO 34018 --- [ocp-schedules-22,0bdaa96f8e7c42e2,371318c859dc841e] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:25:42.565 WARN 34018 --- [ocp-async-4,1205c8a04ab6ef43,a7636c036743ae7d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:42.565 INFO 34018 --- [ocp-async-6,a9f7dbf7e9a0e70e,76a9fc37edf002e2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:42.568 INFO 34018 --- [prometheus-minute-schedule-1,b579f37df9801ba3,53b1d0d80e1c34b7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:43.052 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:43.054 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:44.565 WARN 34018 --- [ocp-async-7,ead142d42214f28d,090fd41abbe9e735] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:44.566 INFO 34018 --- [ocp-async-5,30e990e4e8114f02,f5e9ae200c42bb19] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:45.568 INFO 34018 --- [prometheus-minute-schedule-1,3d1e29ab49f6f227,e3d3b69b0e736eac] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:46.054 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:46.056 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:46.566 INFO 34018 --- [ocp-async-9,1beb1550fc0197e1,158ff899e1c59ae0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:46.566 WARN 34018 --- [ocp-async-8,344669bfaf63cefa,088d6aa15818a37d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:48.456 INFO 34018 --- [ocp-schedules-26,190d67955fa32f5f,9ef5f3be44e43cd8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:25:48.457 INFO 34018 --- [ocp-schedules-5,08d5d86c3818d28a,027d90dd1fb77d8f] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:25:48.457 INFO 34018 --- [ocp-schedules-13,f35218ebf23aa940,bfbbe1237d3bda4d] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:25:48.458 INFO 34018 --- [ocp-schedules-4,63ba3ef334e27f4a,f14cab448bbc878c] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:25:48.458 INFO 34018 --- [ocp-schedules-3,fb744d81fd0d2207,2d420b316b8b6b64] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:25:48.458 INFO 34018 --- [ocp-schedules-7,7b756af87e650d3c,7b51d4583e8c509f] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:25:48.463 INFO 34018 --- [ocp-schedules-26,190d67955fa32f5f,9ef5f3be44e43cd8] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:25:48.464 INFO 34018 --- [ocp-schedules-23,19a8732caa2fcea1,81277f34bd4dcaef] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:25:48.466 INFO 34018 --- [ocp-schedules-3,fb744d81fd0d2207,2d420b316b8b6b64] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:25:48.470 INFO 34018 --- [ocp-schedules-12,ea2e7be52ceb24cd,a875166a9d8bc878] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:25:48.470 INFO 34018 --- [ocp-schedules-10,82eb80b7feb6ad50,734ab1dde35064c7] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:25:48.470 INFO 34018 --- [ocp-schedules-10,82eb80b7feb6ad50,734ab1dde35064c7] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:25:48.470 INFO 34018 --- [ocp-schedules-12,ea2e7be52ceb24cd,a875166a9d8bc878] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:25:48.471 INFO 34018 --- [ocp-schedules-16,764a65fc72c74795,d9643d11386b93b4] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:25:48.471 INFO 34018 --- [ocp-schedules-16,764a65fc72c74795,d9643d11386b93b4] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:25:48.493 INFO 34018 --- [ocp-async-4,1673bed48f41d224,ca00354924c1a825] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:25:48.513 INFO 34018 --- [ocp-schedules-25,b388188f1ca55729,bf743b0ba121002f] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2024-12-31 18:25:48.515 INFO 34018 --- [ocp-schedules-28,e06d1ac3a08b6552,971f625f9a444c42] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:25:48.515 INFO 34018 --- [ocp-schedules-21,453c0d38f56f2b8f,da1456693628e083] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1396,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":349,"seriesIdKeySize":349,"secondWriteQueue":0,"minuteWriteCacheSize":348} 2024-12-31 18:25:48.515 INFO 34018 --- [ocp-schedules-21,453c0d38f56f2b8f,da1456693628e083] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=33, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=33, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:25:48.528 INFO 34018 --- [ocp-schedules-19,7485efb5e2acedef,b7cd52f20b2d7936] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[] 2024-12-31 18:25:48.528 INFO 34018 --- [ocp-schedules-19,7485efb5e2acedef,b7cd52f20b2d7936] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2024-12-31 18:25:48.529 INFO 34018 --- [ocp-schedules-9,eb8dae8d3898a4e2,879a3d03cae81cf0] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:25:48.530 INFO 34018 --- [ocp-schedules-30,3d42351a1c893d10,e198e86c7a9773cd] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:25:48.535 INFO 34018 --- [ocp-schedules-29,9abef739f9c5f73d,58f338bc72c4114a] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:25:48.535+08:00, clusters=[] 2024-12-31 18:25:48.538 INFO 34018 --- [ocp-schedules-13,6e1d3116901fd6e5,d90898d1896e680a] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:25:48.538 INFO 34018 --- [ocp-schedules-13,6e1d3116901fd6e5,d90898d1896e680a] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:25:48.538 INFO 34018 --- [ocp-schedules-9,5d492c3ef9e9175c,0729296f357bcdcd] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:25:48.538 INFO 34018 --- [ocp-schedules-29,45d001a21a550579,a310795ec2318dd0] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:25:48.538+08:00, clusters=[] 2024-12-31 18:25:48.540 INFO 34018 --- [ocp-schedules-13,6e1d3116901fd6e5,d90898d1896e680a] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:25:48.540 INFO 34018 --- [ocp-schedules-13,6e1d3116901fd6e5,d90898d1896e680a] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:25:48.545 INFO 34018 --- [ocp-schedules-4,337dd34aff56af07,bcf0c6a233ec1e04] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:25:48.545 INFO 34018 --- [ocp-schedules-4,337dd34aff56af07,bcf0c6a233ec1e04] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:25:48.550 INFO 34018 --- [ocp-schedules-3,9f353b15a0a02fbe,dae823857c45ff7c] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:25:48.552 INFO 34018 --- [ocp-schedules-5,0cd1bdb7bc1f4ca8,4bb43dbacd36aa52] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:25:48.566 WARN 34018 --- [ocp-async-2,2e4a768f0f88630c,31d1a71e33db4e49] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:48.566 INFO 34018 --- [ocp-async-6,fa4c7030c970bd4d,53b51473c294c297] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:48.568 INFO 34018 --- [prometheus-minute-schedule-1,70add74d6f251735,d7487c5e230c11ec] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:48.571 INFO 34018 --- [ocp-schedules-10,b607399c14c68fd2,d034caacdd38a4c0] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:25:48.575 INFO 34018 --- [ocp-schedules-10,b607399c14c68fd2,d034caacdd38a4c0] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:25:48.576 INFO 34018 --- [ocp-schedules-10,b607399c14c68fd2,d034caacdd38a4c0] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 0 2024-12-31 18:25:48.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:25:48.587846+08:00, lastProcessTime=2024-12-31T18:25:38.589319+08:00 2024-12-31 18:25:48.632 INFO 34018 --- [ocp-schedules-27,6c6ad60f77e6afb7,fbee8760393c9640] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:25:48.632 INFO 34018 --- [ocp-schedules-27,6c6ad60f77e6afb7,fbee8760393c9640] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:25:48.633 INFO 34018 --- [ocp-schedules-27,6c6ad60f77e6afb7,fbee8760393c9640] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:25:48.633 INFO 34018 --- [ocp-schedules-27,6c6ad60f77e6afb7,fbee8760393c9640] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:25:48.634 INFO 34018 --- [ocp-schedules-27,6c6ad60f77e6afb7,fbee8760393c9640] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:25:48.634 INFO 34018 --- [ocp-schedules-27,6c6ad60f77e6afb7,fbee8760393c9640] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730651867074035712 2024-12-31 18:25:48.729 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:25:48.587846+08:00 2024-12-31 18:25:49.056 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:49.059 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:49.074 INFO 34018 --- [ocp-schedules-6,592f26362555efe0,1ebeafa60e06b5d2] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:25:49.084 INFO 34018 --- [ocp-schedules-6,592f26362555efe0,1ebeafa60e06b5d2] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:25:49.084 INFO 34018 --- [ocp-schedules-6,592f26362555efe0,1ebeafa60e06b5d2] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:25:50.566 WARN 34018 --- [ocp-async-8,0d5aab187601be75,e757a1ecbbaeea86] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:50.566 INFO 34018 --- [ocp-async-6,d7988934945bd9d1,54004245a9159043] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:50.688 INFO 34018 --- [ocp-schedules-21,84578599f026abb1,87e177a2a2b75540] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:25:51.568 INFO 34018 --- [prometheus-minute-schedule-1,2b6fc33cf73f6bc5,be4e68809536a367] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:51.889 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:25:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:25:52.059 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:52.061 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:52.205 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2024-12-31 18:25:52.205 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.ocp.core.property.PropertyService : Refresh config properties 2024-12-31 18:25:52.210 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:25:52.211 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:25:52.211 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:25:52.211 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:25:52.217 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:25:52.217 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:25:52.217 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:25:52.217 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:25:52.254 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:25:52.261 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:25:52.261 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:25:52.261 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:25:52.261 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:25:52.261 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:25:52.272 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:25:52.566 WARN 34018 --- [ocp-async-10,6eb80ebb6e6aeaae,e3ca34c3f0bc9411] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:52.566 INFO 34018 --- [ocp-async-3,1c06b537e97cb8b9,82d25d54574013d5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:52.792 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2024-12-31 18:25:53.311 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT1.094577274S 2024-12-31 18:25:53.312 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:25:53.402 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2024-12-31 18:25:53.402 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2024-12-31 18:25:53.436 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 2024-12-31 18:25:53.493 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:25:53.493 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:25:53.493 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:25:53.493 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:25:53.493 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:25:53.493 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2024-12-31 18:25:53.503 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:25:53.658 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] o.s.boot.SpringApplication : Started application in 1.447 seconds (JVM running for 509.506) 2024-12-31 18:25:53.658 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT1.447606854S 2024-12-31 18:25:54.156 INFO 34018 --- [ocp-schedules-26,ef77f04efb91d661,083b1f70d84f3756] c.o.ocp.core.property.PropertyService : Refresh config properties done 2024-12-31 18:25:54.566 WARN 34018 --- [ocp-async-4,504684fa4a43dcce,9b925dfb43a4b342] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:54.566 INFO 34018 --- [ocp-async-2,0b372fdf34d16a85,39e31817db0bccf2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:54.568 INFO 34018 --- [prometheus-minute-schedule-1,7fcf94bdc2f02d60,0f408b73041127d5] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:55.061 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:55.064 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:56.567 WARN 34018 --- [ocp-async-8,786e511fcbceb62e,b55b48d349c6dd9d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:56.567 INFO 34018 --- [ocp-async-7,d34a98390b598137,0a88427922011076] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:57.568 INFO 34018 --- [prometheus-minute-schedule-1,f433bfbd09f97e4a,a4537a6cbf57d842] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640760, interval=60 2024-12-31 18:25:58.064 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:25:58.066 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:25:58.493 INFO 34018 --- [ocp-async-7,f60669890bb3f160,fbf47751c1199556] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:25:58.518 INFO 34018 --- [ocp-schedules-19,86beedb004cc0c07,46a14a31e0df8914] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:25:58.567 WARN 34018 --- [ocp-async-3,5c51061756b86e12,c36ab45ae9418a96] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:25:58.567 INFO 34018 --- [ocp-async-9,2b4e316f062b939a,9bdd5903ae2aae49] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:25:58.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:25:58.589102+08:00, lastProcessTime=2024-12-31T18:25:48.587846+08:00 2024-12-31 18:25:58.757 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:25:58.589102+08:00 2024-12-31 18:26:00.567 WARN 34018 --- [ocp-async-8,9adcdfdc93f278f6,8433b6b943f43f71] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:00.567 INFO 34018 --- [ocp-async-2,754fb5f66b238c6b,28648a807cd5f857] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:00.568 INFO 34018 --- [prometheus-minute-schedule-1,554b3a59b9e18513,d36d802ffc4690f2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:00.754 INFO 34018 --- [ocp-schedules-16,90d2bc01da31a688,6b9f8621c7166aaf] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:26:01.067 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:01.069 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:02.567 WARN 34018 --- [ocp-async-7,c3fd30a01e944ae6,b47a1781dd1cdf7b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:02.567 INFO 34018 --- [ocp-async-5,f970848de2aa571c,cf15fe05e0a76e11] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:03.568 INFO 34018 --- [prometheus-minute-schedule-1,0edea6ffe79346fa,edc1c5c90f959c46] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:04.069 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:04.071 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:04.218 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:26:04.218 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:26:04.220 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:26:04.220 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:26:04.221 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2024-12-31 18:26:04.224 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=3ms, period=120000ms 2024-12-31 18:26:04.567 WARN 34018 --- [ocp-async-4,86a4a8bd0a075755,50963e30bd53755c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:04.568 INFO 34018 --- [ocp-async-10,bcd355d359de0e89,a14457bcdde265ff] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:06.568 WARN 34018 --- [ocp-async-1,c4cf3793c8971e3f,2f871bf3323ef692] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:06.568 INFO 34018 --- [ocp-async-8,78dccd0b61ca64b2,513e4df92c08c965] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:06.568 INFO 34018 --- [prometheus-minute-schedule-1,0f12e02ba113253d,1f445a4cd0e4c249] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:07.072 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:07.074 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:08.493 INFO 34018 --- [ocp-async-8,c8e6c35775079de4,f011147afb7a20e4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:26:08.518 INFO 34018 --- [ocp-schedules-23,be53e7952fd7e826,ba1c0a6ca0a3f21f] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:26:08.568 WARN 34018 --- [ocp-async-7,f816179cf582a15b,07204238b1f0a260] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:08.568 INFO 34018 --- [ocp-async-5,af6fa7fff82dea1a,a781b57377884514] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:08.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:26:08.587988+08:00, lastProcessTime=2024-12-31T18:25:58.589102+08:00 2024-12-31 18:26:08.778 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:26:08.587988+08:00 2024-12-31 18:26:09.087 INFO 34018 --- [ocp-schedules-3,ddd46ffb0dfaa76a,aecd5be2dd698a65] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:26:09.097 INFO 34018 --- [ocp-schedules-3,ddd46ffb0dfaa76a,aecd5be2dd698a65] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:26:09.097 INFO 34018 --- [ocp-schedules-3,ddd46ffb0dfaa76a,aecd5be2dd698a65] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:26:09.568 INFO 34018 --- [prometheus-minute-schedule-1,70023b1a7161ad0b,bd6cf18bc12305da] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:10.002 INFO 34018 --- [ocp-schedules-28,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:26:10.003 INFO 34018 --- [ocp-schedules-20,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:26:10.074 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:10.076 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:10.568 WARN 34018 --- [ocp-async-3,707e1a99082aa591,88b6053b513cf6ab] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:10.568 INFO 34018 --- [ocp-async-10,82cb10d2cd03496d,d370413da2efd647] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:10.799 INFO 34018 --- [ocp-schedules-9,30cbee9f253bc0c8,bfbf882418b0ef78] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:26:10.889 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-12-31 18:26:10.908 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-12-31 18:26:12.568 INFO 34018 --- [prometheus-minute-schedule-1,1a7c500a84ba5f00,67fcd5941294745a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:12.568 WARN 34018 --- [ocp-async-1,b4c294afd538822c,b719c4209e15d3c3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:12.568 INFO 34018 --- [ocp-async-8,feee565c815502a2,71bb407e8edc25d9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:12.569 INFO 34018 --- [prometheus-hour-schedule-1,d21d51691396ae62,b2ddafa15ee52df3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:26:12.642 INFO 34018 --- [metric-archive-second-12,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640700, nodeCount=30, affectRows=30 2024-12-31 18:26:12.643 INFO 34018 --- [metric-archive-second-12,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640700, nodeCount=30, validCount=30 2024-12-31 18:26:12.644 INFO 34018 --- [metric-archive-second-40,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640700, nodeCount=59, affectRows=59 2024-12-31 18:26:12.644 INFO 34018 --- [metric-archive-second-27,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640700, nodeCount=43, affectRows=43 2024-12-31 18:26:12.645 INFO 34018 --- [metric-archive-second-27,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640700, nodeCount=43, validCount=43 2024-12-31 18:26:12.645 INFO 34018 --- [metric-archive-second-28,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640700, nodeCount=72, affectRows=72 2024-12-31 18:26:12.645 INFO 34018 --- [metric-archive-second-40,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640700, nodeCount=59, validCount=59 2024-12-31 18:26:12.645 INFO 34018 --- [metric-archive-second-38,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640700, nodeCount=62, affectRows=62 2024-12-31 18:26:12.645 INFO 34018 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640700, nodeCount=46, affectRows=46 2024-12-31 18:26:12.645 INFO 34018 --- [metric-archive-second-29,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640700, nodeCount=37, affectRows=37 2024-12-31 18:26:12.645 INFO 34018 --- [metric-archive-second-1,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640700, nodeCount=46, validCount=46 2024-12-31 18:26:12.645 INFO 34018 --- [metric-archive-second-29,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640700, nodeCount=36, validCount=36 2024-12-31 18:26:12.646 INFO 34018 --- [metric-archive-second-28,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640700, nodeCount=72, validCount=72 2024-12-31 18:26:12.646 INFO 34018 --- [metric-archive-second-38,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640700, nodeCount=62, validCount=62 2024-12-31 18:26:13.076 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:13.078 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:14.568 WARN 34018 --- [ocp-async-2,ca0aefd15a84480d,f97128d47dfd2a70] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:14.569 INFO 34018 --- [ocp-async-6,064b30bc93b37e19,866ad750f48b3503] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:15.568 INFO 34018 --- [prometheus-minute-schedule-1,92673feccd2b6717,d657263bf57e754f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:16.078 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:16.080 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:16.569 WARN 34018 --- [ocp-async-6,c547769ba5299038,9034cf8509e7a008] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:16.569 INFO 34018 --- [ocp-async-3,905b773f2cb176af,0c485d6d62f04cbd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:18.457 INFO 34018 --- [ocp-schedules-8,a62ebec285f6f972,a0c03d9f82ea8e51] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:26:18.458 INFO 34018 --- [ocp-schedules-1,14826479f7720027,3b88be2bd064062a] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:26:18.458 INFO 34018 --- [ocp-schedules-28,bf137f4d6b7e27d6,4959e12256526669] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:26:18.459 INFO 34018 --- [ocp-schedules-6,ad1a94ec5e01fc51,9086edadab111248] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:26:18.466 INFO 34018 --- [ocp-schedules-9,967d20c80e23d7f8,b1e9c46fb4dc713a] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:26:18.471 INFO 34018 --- [ocp-schedules-21,d2dc9c0987120710,0e1a56a328a9033b] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:26:18.471 INFO 34018 --- [ocp-schedules-21,d2dc9c0987120710,0e1a56a328a9033b] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:26:18.471 INFO 34018 --- [ocp-schedules-12,f24e8bb34104c02a,83e86dd533be014e] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:26:18.471 INFO 34018 --- [ocp-schedules-12,f24e8bb34104c02a,83e86dd533be014e] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:26:18.472 INFO 34018 --- [ocp-schedules-14,189ed085703eb604,995de8cbef66e22b] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:26:18.472 INFO 34018 --- [ocp-schedules-14,189ed085703eb604,995de8cbef66e22b] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:26:18.494 INFO 34018 --- [ocp-async-3,e3a4c9dc72b278e8,14d287ff947e2429] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:26:18.518 INFO 34018 --- [ocp-schedules-26,238fe84d162d956f,43c9142781567c99] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:26:18.553 INFO 34018 --- [ocp-schedules-18,dc502880635d37d8,d33153133d464451] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:26:18.568 INFO 34018 --- [prometheus-minute-schedule-1,20e1be03bc212f77,af8dc85e568bf38e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:18.569 WARN 34018 --- [ocp-async-10,ff4eb3242fa3fa84,f141172ede1c9163] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:18.570 INFO 34018 --- [ocp-async-9,3d85f23b9090a123,5848b9ae6c9b356c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:18.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:26:18.589038+08:00, lastProcessTime=2024-12-31T18:26:08.587988+08:00 2024-12-31 18:26:18.762 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:26:18.589038+08:00 2024-12-31 18:26:19.080 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:19.082 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:20.569 WARN 34018 --- [ocp-async-9,bd3a3dbcc502210f,a70c1929ff14f73a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:20.571 INFO 34018 --- [ocp-async-7,e11e8330c0667ff6,88de56ebd5538aae] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:20.850 INFO 34018 --- [ocp-schedules-25,f4ea0bf4b1269de4,b56a7cb85b77dc0f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:26:21.568 INFO 34018 --- [prometheus-minute-schedule-1,93fbe45606b50cff,02e1fc2902c1d00a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:22.083 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:22.085 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:22.569 WARN 34018 --- [ocp-async-4,fbb8bcee1695abb4,473a16bba8c9a84a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:22.571 INFO 34018 --- [ocp-async-5,980eb2f90c669d35,e2683a9b1789f443] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:24.568 INFO 34018 --- [prometheus-minute-schedule-1,9850d9d9eef88a9b,cfc9f986048b1d7b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:24.569 WARN 34018 --- [ocp-async-10,de307421a0687fdc,bc5b0bb08c88161f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:24.571 INFO 34018 --- [ocp-async-1,e59cc6d92a52aca1,a30f01f5d3f3f7db] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:25.085 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:25.087 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:26.570 WARN 34018 --- [ocp-async-9,1538bb79cea9d73f,7a5951b9d000eb57] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:26.571 INFO 34018 --- [ocp-async-2,46337c532c5fd270,cb36833e858ddb44] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:27.568 INFO 34018 --- [prometheus-minute-schedule-1,df5829cac90d245a,f582baf5c94da833] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:28.087 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:28.089 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:28.494 INFO 34018 --- [ocp-async-2,d470c47a80960882,c5de889952e456aa] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:26:28.518 INFO 34018 --- [ocp-schedules-28,eebeb407e04c2b68,bf0e965ae56381bd] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:26:28.570 WARN 34018 --- [ocp-async-4,b0f8a09acfb277c4,38bcab8a39043339] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:28.571 INFO 34018 --- [ocp-async-3,f03ca7e1d7fdc65a,6b9aa4611ddd5405] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:28.588 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:26:28.588288+08:00, lastProcessTime=2024-12-31T18:26:18.589038+08:00 2024-12-31 18:26:28.745 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:26:28.588288+08:00 2024-12-31 18:26:29.101 INFO 34018 --- [ocp-schedules-6,d15086b3bdbc97d4,48c9c8d81a5f395f] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:26:29.110 INFO 34018 --- [ocp-schedules-6,d15086b3bdbc97d4,48c9c8d81a5f395f] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:26:29.110 INFO 34018 --- [ocp-schedules-6,d15086b3bdbc97d4,48c9c8d81a5f395f] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:26:30.568 INFO 34018 --- [prometheus-minute-schedule-1,34b08d41578cfdf2,c3e185e0a0c58b7c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:30.570 WARN 34018 --- [ocp-async-10,b67ed84e55cb3237,4a7154916964f502] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:30.571 INFO 34018 --- [ocp-async-1,da6905f4967e3a43,8dddb95bf1c1d5f5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:30.891 INFO 34018 --- [ocp-schedules-27,cf5179e5fd2601ce,53ab3a488a3034d0] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:26:31.089 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:31.092 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:32.570 WARN 34018 --- [ocp-async-9,dd2c9acc3fa913f7,3dada702186479f4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:32.572 INFO 34018 --- [ocp-async-6,592162326a6a311e,f95052691902c77f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:33.568 INFO 34018 --- [prometheus-minute-schedule-1,1c486048a3040c6a,e7a36fda561c7925] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:34.092 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:34.094 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:34.571 WARN 34018 --- [ocp-async-2,29cc1f092e7f0365,234a96f33646b7be] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:34.572 INFO 34018 --- [ocp-async-7,3f10d083e45006a3,5f39c4add0bdd2fa] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:36.568 INFO 34018 --- [prometheus-minute-schedule-1,dcc69c5db4046abc,511732e8455479eb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:36.569 INFO 34018 --- [prometheus-cache-monitor1,10063929d7779161,44388ebf73a5139a] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1396,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":349,"seriesIdKeySize":349,"secondWriteQueue":0,"minuteWriteCacheSize":348} 2024-12-31 18:26:36.570 INFO 34018 --- [prometheus-cache-monitor1,10063929d7779161,44388ebf73a5139a] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=33, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=33, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:26:36.571 WARN 34018 --- [ocp-async-3,375901f0713a3614,7093e55ca73dd5ca] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:36.572 INFO 34018 --- [ocp-async-5,815bd5cc935aa42f,da4773f938a8adee] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:36.622 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2024-12-31T18:22:36.59, end=2024-12-31T18:24:36.615} 2024-12-31 18:26:36.632 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [] 2024-12-31 18:26:36.632 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2024-12-31 18:26:37.094 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:37.096 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:38.494 INFO 34018 --- [ocp-async-5,71c4ad4e03cd5b95,d9304461b525676e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:26:38.518 INFO 34018 --- [ocp-schedules-26,a69134f6962c30d5,689c36414dc8e900] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:26:38.571 WARN 34018 --- [ocp-async-9,b20b400b33409939,cf5e6cee2d868451] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:38.572 INFO 34018 --- [ocp-async-6,b428c7f9db49f90c,d1dfa0b5400dd539] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:38.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:26:38.588892+08:00, lastProcessTime=2024-12-31T18:26:28.588288+08:00 2024-12-31 18:26:38.765 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:26:38.588892+08:00 2024-12-31 18:26:39.568 INFO 34018 --- [prometheus-minute-schedule-1,521bdc247e4c66d1,339b703c84a12abf] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:40.004 INFO 34018 --- [ocp-schedules-11,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:26:40.007 INFO 34018 --- [ocp-schedules-2,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:26:40.096 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:40.098 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:40.571 WARN 34018 --- [ocp-async-2,72f07ce63382b423,bb3c7a7a789f38ef] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:40.572 INFO 34018 --- [ocp-async-7,2b9b562311c718c2,d73a7e56c3d5f710] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:40.950 INFO 34018 --- [ocp-schedules-20,5d73aa438f97ffca,0b982ef488167a85] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:26:42.568 INFO 34018 --- [prometheus-minute-schedule-1,0718a9dbbfdc29cd,70c004efd2cccf24] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:42.571 WARN 34018 --- [ocp-async-3,7d0dd1bdd4b903f3,54b20a096d0ba7c0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:42.573 INFO 34018 --- [ocp-async-5,e34474f0d0f74af1,21a7002f8bfc2fad] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:43.098 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:43.100 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:44.572 WARN 34018 --- [ocp-async-1,3a22b8441f0c85e2,99f415bc83ed19ab] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:44.573 INFO 34018 --- [ocp-async-8,262a854ec8989b18,89fc8b039afc38cb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:45.568 INFO 34018 --- [prometheus-minute-schedule-1,36eef6b253280099,4348ae30fbe0d0ac] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:46.100 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:46.102 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:46.572 WARN 34018 --- [ocp-async-2,4390edf0b932d024,076c6eb347db4111] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:46.573 INFO 34018 --- [ocp-async-4,91f7159875eda026,a862e1f966cc2bee] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:48.456 INFO 34018 --- [ocp-schedules-27,51d9fa8de30199d9,dfa9e4d3b7b745d4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:26:48.457 INFO 34018 --- [ocp-schedules-12,24c4db0a110a827c,7a6f3dd27a8ead36] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:26:48.457 INFO 34018 --- [ocp-schedules-26,cd300044df740975,5a00793c2a94f3ed] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:26:48.458 INFO 34018 --- [ocp-schedules-9,440d55b3fbb3d496,3b66383bb60ba391] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:26:48.458 INFO 34018 --- [ocp-schedules-18,a14ec02e392a29ec,567e960d9a2a0950] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:26:48.459 INFO 34018 --- [ocp-schedules-19,1bae625f9df8e28f,932858b9b5393eff] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:26:48.464 INFO 34018 --- [ocp-schedules-10,b23de73109d04c79,1285785356585374] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:26:48.464 INFO 34018 --- [ocp-schedules-27,51d9fa8de30199d9,dfa9e4d3b7b745d4] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:26:48.466 INFO 34018 --- [ocp-schedules-19,1bae625f9df8e28f,932858b9b5393eff] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:26:48.472 INFO 34018 --- [ocp-schedules-17,a5681cea2cf8ac77,a844a788352a6faf] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:26:48.472 INFO 34018 --- [ocp-schedules-6,2e0bdc0c614a2dca,5f80575f8fe45131] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:26:48.472 INFO 34018 --- [ocp-schedules-6,2e0bdc0c614a2dca,5f80575f8fe45131] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:26:48.472 INFO 34018 --- [ocp-schedules-17,a5681cea2cf8ac77,a844a788352a6faf] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:26:48.472 INFO 34018 --- [ocp-schedules-22,33f8a018c620b266,84d9aa4c6c11b593] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:26:48.472 INFO 34018 --- [ocp-schedules-22,33f8a018c620b266,84d9aa4c6c11b593] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:26:48.487 INFO 34018 --- [ocp-schedules-4,2f6fe6e9d874ac74,c2a44ad0387e9a10] c.o.o.s.common.scheduled.PerfSchedules : Collect high risk sql audit stat, time=2024-12-31T18:26:48.487+08:00, tenantSize=0 2024-12-31 18:26:48.494 INFO 34018 --- [ocp-async-3,dbc257650ab17871,3f5c64348dd8e486] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:26:48.520 INFO 34018 --- [ocp-schedules-21,8e89515e75fd8886,caaf3baceb5c33b8] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:26:48.533 INFO 34018 --- [ocp-schedules-3,f9e9cf1f004390d6,79566cd5176cb483] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:26:48.534 INFO 34018 --- [ocp-schedules-15,67f6ada19dab4e58,e3d44319a79e3f77] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:26:48.537 INFO 34018 --- [ocp-schedules-11,7e185e77f5e60a26,563f3b97e61d275b] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[] 2024-12-31 18:26:48.537 INFO 34018 --- [ocp-schedules-11,7e185e77f5e60a26,563f3b97e61d275b] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2024-12-31 18:26:48.538 INFO 34018 --- [ocp-schedules-13,476ce5ebf7f11c3c,3d87c3cda34e0e3c] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:26:48.538+08:00, clusters=[] 2024-12-31 18:26:48.540 INFO 34018 --- [ocp-schedules-8,5dd707eaf6f545ec,f45135962d5d1cda] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:26:48.540 INFO 34018 --- [ocp-schedules-8,5dd707eaf6f545ec,f45135962d5d1cda] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:26:48.540 INFO 34018 --- [ocp-schedules-1,6890be516506dd13,3fb4ca44f788dcf9] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:26:48.541 INFO 34018 --- [ocp-schedules-24,01d953badbf4e649,88fa49f74400b656] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:26:48.541+08:00, clusters=[] 2024-12-31 18:26:48.542 INFO 34018 --- [ocp-schedules-8,5dd707eaf6f545ec,f45135962d5d1cda] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:26:48.542 INFO 34018 --- [ocp-schedules-8,5dd707eaf6f545ec,f45135962d5d1cda] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:26:48.548 INFO 34018 --- [ocp-schedules-12,df5e09a79209e5e2,d7a80ab7720a858b] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:26:48.548 INFO 34018 --- [ocp-schedules-12,df5e09a79209e5e2,d7a80ab7720a858b] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:26:48.554 INFO 34018 --- [ocp-schedules-18,141f790d8477d6b4,b50a1c398cc39016] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:26:48.555 INFO 34018 --- [ocp-schedules-9,91bc4a53de16cc58,cd7ed8ee72a617f1] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:26:48.568 INFO 34018 --- [prometheus-minute-schedule-1,d18aaafad60429f3,1cc4da9720c8849b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:48.572 WARN 34018 --- [ocp-async-1,9cbb9d3ca2c74286,2aac6478a54764fd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:48.573 INFO 34018 --- [ocp-async-9,b9d914aa8912d6f9,3cfa5bb90a2981ae] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:48.576 INFO 34018 --- [ocp-schedules-22,1f9f45e81e49caf5,b51c8efa799a6c87] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:26:48.580 INFO 34018 --- [ocp-schedules-22,1f9f45e81e49caf5,b51c8efa799a6c87] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:26:48.580 INFO 34018 --- [ocp-schedules-22,1f9f45e81e49caf5,b51c8efa799a6c87] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 0 2024-12-31 18:26:48.588 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:26:48.587778+08:00, lastProcessTime=2024-12-31T18:26:38.588892+08:00 2024-12-31 18:26:48.612 INFO 34018 --- [ocp-schedules-29,5ee9a2bcf5639134,b948f10a32911639] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2024-12-31 18:26:48.613 INFO 34018 --- [ocp-schedules-29,5ee9a2bcf5639134,b948f10a32911639] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2024-12-31 18:26:48.635 INFO 34018 --- [ocp-schedules-4,61c0f5b6af5ecc1e,1dc12575703c1df6] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:26:48.635 INFO 34018 --- [ocp-schedules-4,61c0f5b6af5ecc1e,1dc12575703c1df6] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:26:48.642 INFO 34018 --- [ocp-schedules-4,61c0f5b6af5ecc1e,1dc12575703c1df6] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:26:48.642 INFO 34018 --- [ocp-schedules-4,61c0f5b6af5ecc1e,1dc12575703c1df6] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:26:48.647 INFO 34018 --- [ocp-schedules-4,61c0f5b6af5ecc1e,1dc12575703c1df6] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:26:48.647 INFO 34018 --- [ocp-schedules-4,61c0f5b6af5ecc1e,1dc12575703c1df6] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730651867074035712 2024-12-31 18:26:48.747 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:26:48.587778+08:00 2024-12-31 18:26:49.102 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:49.104 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:49.112 INFO 34018 --- [ocp-schedules-21,f027493f2793dc06,5b81ea19d8cf59ec] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:26:49.122 INFO 34018 --- [ocp-schedules-21,f027493f2793dc06,5b81ea19d8cf59ec] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:26:49.122 INFO 34018 --- [ocp-schedules-21,f027493f2793dc06,5b81ea19d8cf59ec] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:26:50.572 WARN 34018 --- [ocp-async-2,2ee7b03cb807affc,0106dc767d4e3ff7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:50.573 INFO 34018 --- [ocp-async-6,0ba04a17405715ed,1c51412f9b1b2b66] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:50.991 INFO 34018 --- [ocp-schedules-9,7030651325203669,fe5cc57763c5685c] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:26:51.568 INFO 34018 --- [prometheus-minute-schedule-1,f14fb1e8373f8c87,2753a58a7eec08ef] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:51.889 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:26:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:26:52.104 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:52.106 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:52.572 WARN 34018 --- [ocp-async-4,858043a66e5a6a7c,5d416139ebbac1ef] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:52.573 INFO 34018 --- [ocp-async-3,621e6a71d6a6ac6b,5f028be0b9c19bc0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:54.568 INFO 34018 --- [prometheus-minute-schedule-1,6f99a0acb978a78f,c1feb6543548cd05] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:54.573 WARN 34018 --- [ocp-async-1,ee352c849f50378f,4823bb82749167af] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:54.573 INFO 34018 --- [ocp-async-5,6dad116b019b3119,1e7256e0f6bd3fed] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:55.106 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:55.108 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:56.573 WARN 34018 --- [ocp-async-2,a0761b416a114d45,7d9ef6a3c54e71b4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:56.574 INFO 34018 --- [ocp-async-8,a099e88bea83fad3,4068113fcb2631dc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:57.568 INFO 34018 --- [prometheus-minute-schedule-1,dc473512042011b2,50b988c17e3d07cf] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640820, interval=60 2024-12-31 18:26:58.108 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:26:58.110 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:26:58.494 INFO 34018 --- [ocp-async-6,ffa46f6063d8ba83,d7bda03e6c6899c4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:26:58.520 INFO 34018 --- [ocp-schedules-4,e710862167ecd6d9,c3b73381cace176e] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:26:58.573 WARN 34018 --- [ocp-async-4,a0a2ddb82d4b3ef0,d7631ff0472dfc7f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:26:58.574 INFO 34018 --- [ocp-async-3,8423422730920a96,e3874ce56a2c7449] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:26:58.588 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:26:58.588517+08:00, lastProcessTime=2024-12-31T18:26:48.587778+08:00 2024-12-31 18:26:58.748 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:26:58.588517+08:00 2024-12-31 18:27:00.568 INFO 34018 --- [prometheus-minute-schedule-1,184ff395eda65ea4,b1568a6c6971d1cd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:00.573 WARN 34018 --- [ocp-async-3,d7f3152e8af95536,4550704bf0898668] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:00.574 INFO 34018 --- [ocp-async-5,b22ed5d4aad0465a,28777c3f6d53bfe5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:01.045 INFO 34018 --- [ocp-schedules-14,2c231b3c6dffe438,51b805dc035e69e2] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:27:01.110 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:01.111 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:02.573 WARN 34018 --- [ocp-async-8,13405446b320f62c,d0f782d6c6970364] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:02.574 INFO 34018 --- [ocp-async-9,5455e368b9bcc2d9,cd2cb3e36db7ee64] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:03.568 INFO 34018 --- [prometheus-minute-schedule-1,def557a005830e83,85de0cefd9e61d45] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:04.111 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:04.113 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:04.573 WARN 34018 --- [ocp-async-9,38a6fe8a84b358e6,da46a7f9314c54af] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:04.574 INFO 34018 --- [ocp-async-1,bab47da3d901d32b,ded141ea63b7ffd8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:06.568 INFO 34018 --- [prometheus-minute-schedule-1,049b49c49bb0273f,b55994010776ff82] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:06.574 WARN 34018 --- [ocp-async-3,c624ed50d6989eda,a607f4bb52ba4e7a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:06.575 INFO 34018 --- [ocp-async-2,b83b62f7389662df,a22f763e49446a76] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:07.113 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:07.115 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:08.495 INFO 34018 --- [ocp-async-10,8adaaad203b46913,445cc3da64d937a3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:27:08.520 INFO 34018 --- [ocp-schedules-3,63f3fc66d71d7fa9,4c5e13f79ee2ac83] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:27:08.574 WARN 34018 --- [ocp-async-8,16c7de9eda3c47e9,5752dc1b1bb0b58a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:08.575 INFO 34018 --- [ocp-async-6,727b37983968a8bd,a6c2a0b69ce24aef] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:08.587 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:27:08.587042+08:00, lastProcessTime=2024-12-31T18:26:58.588517+08:00 2024-12-31 18:27:08.733 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:27:08.587042+08:00 2024-12-31 18:27:09.125 INFO 34018 --- [ocp-schedules-29,95efaebc27e958ee,a3c795e6266311d8] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:27:09.135 INFO 34018 --- [ocp-schedules-29,95efaebc27e958ee,a3c795e6266311d8] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:27:09.135 INFO 34018 --- [ocp-schedules-29,95efaebc27e958ee,a3c795e6266311d8] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:27:09.568 INFO 34018 --- [prometheus-minute-schedule-1,c4df1855ba0bc728,b246669f958b89c8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:10.003 INFO 34018 --- [ocp-schedules-2,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:27:10.004 INFO 34018 --- [ocp-schedules-1,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:27:10.115 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:10.121 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:10.574 WARN 34018 --- [ocp-async-4,30b255adcb65e5f6,120f01aa3a2dd283] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:10.575 INFO 34018 --- [ocp-async-7,3bc4ecd0fd0f2c8a,63a39396c7431896] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:10.889 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-12-31 18:27:10.908 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-12-31 18:27:11.086 INFO 34018 --- [ocp-schedules-8,abe40f9c7b4bbbe1,32452c6a88985597] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:27:12.568 INFO 34018 --- [prometheus-minute-schedule-1,6471300875bcf47f,3fa7ca5174895800] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:12.569 INFO 34018 --- [prometheus-hour-schedule-1,1d890f8b441918f3,ffadf6af86909b9a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:27:12.574 WARN 34018 --- [ocp-async-1,2a840fb9ed8bf8ba,d9557ce49c718be2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:12.575 INFO 34018 --- [ocp-async-2,bf0a3e181c573d8b,9d9d07ed049b3679] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:12.655 INFO 34018 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640760, nodeCount=349, affectRows=349 2024-12-31 18:27:12.657 INFO 34018 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640760, nodeCount=348, validCount=348 2024-12-31 18:27:13.121 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:13.123 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:14.575 WARN 34018 --- [ocp-async-10,25afb1d127766f0e,48aa2a317d8ee466] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:14.575 INFO 34018 --- [ocp-async-5,8174bc10c900c8ee,47c8add7636d04ea] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:15.568 INFO 34018 --- [prometheus-minute-schedule-1,eacffc96ad6a7e15,c7ee40d0031f422a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:16.123 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:16.125 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:16.575 WARN 34018 --- [ocp-async-4,70327190ca4e2aa8,f30c9590255e2b87] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:16.575 INFO 34018 --- [ocp-async-9,62339093c64bc431,b6a259f770f73d2b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:18.462 INFO 34018 --- [ocp-schedules-22,3f1eb8324ef0bfd7,12d93c78bc7fa2c8] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:27:18.462 INFO 34018 --- [ocp-schedules-11,ab27fb481647b90e,d4acf4218511bd42] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:27:18.462 INFO 34018 --- [ocp-schedules-12,8f40c655eb04c066,bd598f9928cbbe3a] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:27:18.462 INFO 34018 --- [ocp-schedules-27,a2c7b62b4fc7b7d9,7c2485b5102378ae] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:27:18.471 INFO 34018 --- [ocp-schedules-25,3d8a9d003f39faf6,705319c11d971501] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:27:18.471 INFO 34018 --- [ocp-schedules-3,849abf4bdeba98a2,d7719bf951828bee] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:27:18.472 INFO 34018 --- [ocp-schedules-25,3d8a9d003f39faf6,705319c11d971501] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:27:18.472 INFO 34018 --- [ocp-schedules-3,849abf4bdeba98a2,d7719bf951828bee] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:27:18.472 INFO 34018 --- [ocp-schedules-30,cffaeb3b1d318684,f658b6290f4bf0f3] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:27:18.472 INFO 34018 --- [ocp-schedules-30,cffaeb3b1d318684,f658b6290f4bf0f3] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:27:18.495 INFO 34018 --- [ocp-async-9,c19e3ee3dd388d24,b0b70fe5ef515236] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:27:18.515 INFO 34018 --- [ocp-schedules-21,cea3fa2ad3ee0f46,957d46b1cb221620] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:27:18.520 INFO 34018 --- [ocp-schedules-9,31993aabf3a42717,25b43e93ea8205dd] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:27:18.560 INFO 34018 --- [ocp-schedules-9,ee285fb28389b265,3e4efadbdca7ff69] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:27:18.568 INFO 34018 --- [prometheus-minute-schedule-1,c2c620d0f64ac314,88599c1b12b91cce] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:18.575 WARN 34018 --- [ocp-async-1,35a7e56937c2fe03,985b0ddb1b7d68b4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:18.575 INFO 34018 --- [ocp-async-2,6620004df9d9d828,f1fd6fcc645272de] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:18.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:27:18.588248+08:00, lastProcessTime=2024-12-31T18:27:08.587042+08:00 2024-12-31 18:27:18.739 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:27:18.588248+08:00 2024-12-31 18:27:19.125 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:19.127 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:20.575 WARN 34018 --- [ocp-async-3,bab73f1e1472ddf7,6db3befde0893cba] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:20.576 INFO 34018 --- [ocp-async-5,fd01e114d61b1897,4ed09f2891966c2a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:21.141 INFO 34018 --- [ocp-schedules-10,fe2cae75d07a597a,052eb645d372da2e] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:27:21.568 INFO 34018 --- [prometheus-minute-schedule-1,14f9a4bb0de08543,d29fb879909835a7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:22.127 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:22.129 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:22.575 WARN 34018 --- [ocp-async-5,fa33fa64b1161b25,c33dc54bbdbf453a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:22.576 INFO 34018 --- [ocp-async-7,800a9a746891e2fc,89baf81da6a314ad] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:24.568 INFO 34018 --- [prometheus-minute-schedule-1,6d48bfc9693c269a,2e3e09fe1e095243] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:24.576 WARN 34018 --- [ocp-async-1,641b70baefa4ab6a,705a43c84d5444c7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:24.576 INFO 34018 --- [ocp-async-10,ba122d928ca52bd5,2ed93c692da8514c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:25.129 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:25.131 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:26.576 WARN 34018 --- [ocp-async-3,9d34d9c1860f4024,f339f82d9ae2a11b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:26.576 INFO 34018 --- [ocp-async-2,8a011a6ac64d341a,868745bc2b8dfcd0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:27.568 INFO 34018 --- [prometheus-minute-schedule-1,4e797c9b8858c18c,c4dcc852c259f83e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:28.131 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:28.133 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:28.495 INFO 34018 --- [ocp-async-2,6286f39f1dd21285,35b848602711dc41] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:27:28.521 INFO 34018 --- [ocp-schedules-25,8723f8fc6d86c0b9,5801d25d03543614] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:27:28.576 WARN 34018 --- [ocp-async-9,0b302fec80788605,f19e964168053d25] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:28.577 INFO 34018 --- [ocp-async-6,a3e972d03359f48b,2f942e2cce6b42e8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:28.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:27:28.589039+08:00, lastProcessTime=2024-12-31T18:27:18.588248+08:00 2024-12-31 18:27:28.769 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:27:28.589039+08:00 2024-12-31 18:27:29.138 INFO 34018 --- [ocp-schedules-29,ab2dd6027efb18d3,1da0f30b3eec2b94] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:27:29.149 INFO 34018 --- [ocp-schedules-29,ab2dd6027efb18d3,1da0f30b3eec2b94] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:27:29.149 INFO 34018 --- [ocp-schedules-29,ab2dd6027efb18d3,1da0f30b3eec2b94] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:27:30.568 INFO 34018 --- [prometheus-minute-schedule-1,f7760b4d8151ac91,90166069b86e04b0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:30.576 WARN 34018 --- [ocp-async-7,9f24853a98958e8a,154fa511533df3e2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:30.577 INFO 34018 --- [ocp-async-10,aebc4e49224de826,f6476c6d020adf2f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:31.133 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:31.134 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:31.181 INFO 34018 --- [ocp-schedules-2,9992233bf68c91ab,57cd86a6486a2ee5] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:27:32.576 WARN 34018 --- [ocp-async-8,9f6b7c9bd58dbd20,fde2085cf0ef9677] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:32.577 INFO 34018 --- [ocp-async-2,af75556334b9190c,cf22f185581ab009] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:33.568 INFO 34018 --- [prometheus-minute-schedule-1,ab106a8d5ac7e5fb,5c76b41232753509] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:34.135 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:34.137 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:34.577 WARN 34018 --- [ocp-async-9,2ec8d907ef8ac27d,2d7a38131aaa61a1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:34.577 INFO 34018 --- [ocp-async-5,dbfb9c928b7c46a6,afdfff7a8cbaf393] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:36.568 INFO 34018 --- [prometheus-minute-schedule-1,1f403ba75069b599,a52aac0a1c1d682f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:36.569 INFO 34018 --- [prometheus-cache-monitor1,c4e7eaa208f866d0,5a5aab90208a18e1] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1396,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":349,"seriesIdKeySize":349,"secondWriteQueue":0,"minuteWriteCacheSize":348} 2024-12-31 18:27:36.570 INFO 34018 --- [prometheus-cache-monitor1,c4e7eaa208f866d0,5a5aab90208a18e1] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=33, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=33, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:27:36.577 WARN 34018 --- [ocp-async-6,950262738b5e132d,4a4fefe4cad40e2d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:36.577 INFO 34018 --- [ocp-async-1,f2727bbdf0894adf,deb477e43512146e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:37.137 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:37.139 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:38.496 INFO 34018 --- [ocp-async-1,aef41f62f808cc46,13209daa7e6fc06a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:27:38.521 INFO 34018 --- [ocp-schedules-11,cb21c0d65143c05a,418209c7fd84e322] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:27:38.577 WARN 34018 --- [ocp-async-8,20158b51c8abbf09,26b2c19aa936c0b7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:38.577 INFO 34018 --- [ocp-async-2,4c13543e62c42eaf,6fa0c5397425a5dd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:38.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:27:38.589825+08:00, lastProcessTime=2024-12-31T18:27:28.589039+08:00 2024-12-31 18:27:38.754 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:27:38.589825+08:00 2024-12-31 18:27:39.568 INFO 34018 --- [prometheus-minute-schedule-1,c3270fed26278fef,098343885720ff80] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:40.008 INFO 34018 --- [ocp-schedules-21,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:27:40.008 INFO 34018 --- [ocp-schedules-23,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:27:40.139 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:40.140 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:40.577 WARN 34018 --- [ocp-async-4,eae029363fa8c68a,7c05131c8b7929a6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:40.578 INFO 34018 --- [ocp-async-5,801ada49bdef4365,22fe2a4df6aa73a4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:41.228 INFO 34018 --- [ocp-schedules-28,faa20d457175edc5,10de71338d1d6163] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:27:42.568 INFO 34018 --- [prometheus-minute-schedule-1,6350bd44fb24b137,2e895f9798453c2d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:42.577 WARN 34018 --- [ocp-async-7,27febc1172880c28,f83f08f494fc81fa] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:42.578 INFO 34018 --- [ocp-async-1,ebd31389a258477e,26196971ef1cba15] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:43.140 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:43.142 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:44.577 WARN 34018 --- [ocp-async-8,9d5b1c18789979da,83bdd67b49a39d6e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:44.578 INFO 34018 --- [ocp-async-3,aa05b46216c9882c,c06a373d77f67802] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:45.568 INFO 34018 --- [prometheus-minute-schedule-1,42a2253d899f1f5a,8ec0c3ff820610eb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:46.142 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:46.144 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:46.578 WARN 34018 --- [ocp-async-3,9a5ebd8dd7fc422a,e04aa69550d986b7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:46.578 INFO 34018 --- [ocp-async-4,e613e22575a80634,9776454e4b9d2cdd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:48.456 INFO 34018 --- [ocp-schedules-9,28f463be194a112b,ad6ea072998a0090] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:27:48.458 INFO 34018 --- [ocp-schedules-12,7458a385af41a386,efa20c1f6b29f819] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:27:48.458 INFO 34018 --- [ocp-schedules-14,82942586919b6eb4,df1277db59a41fe5] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:27:48.458 INFO 34018 --- [ocp-schedules-24,e24df009ccad6b46,7ccb1deec6a6eeec] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:27:48.458 INFO 34018 --- [ocp-schedules-27,07ccdda34c66b16c,a7f07d0d501cfde0] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:27:48.459 INFO 34018 --- [ocp-schedules-18,77239d773bf5bb96,0507be2d084e2e92] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:27:48.466 INFO 34018 --- [ocp-schedules-9,28f463be194a112b,ad6ea072998a0090] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:27:48.466 INFO 34018 --- [ocp-schedules-15,244b0ae3986421ce,f0da0408e3e7c175] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:27:48.467 INFO 34018 --- [ocp-schedules-27,07ccdda34c66b16c,a7f07d0d501cfde0] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:27:48.471 INFO 34018 --- [ocp-schedules-17,02a49f9386cb48bc,633d7bc166cc9730] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:27:48.471 INFO 34018 --- [ocp-schedules-17,02a49f9386cb48bc,633d7bc166cc9730] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:27:48.471 INFO 34018 --- [ocp-schedules-2,bd8479d3d9a87af1,f671cc104909cee4] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:27:48.471 INFO 34018 --- [ocp-schedules-2,bd8479d3d9a87af1,f671cc104909cee4] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:27:48.472 INFO 34018 --- [ocp-schedules-20,1b66469beffe2a91,d34afbc8727b2d44] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:27:48.472 INFO 34018 --- [ocp-schedules-20,1b66469beffe2a91,d34afbc8727b2d44] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:27:48.496 INFO 34018 --- [ocp-async-7,e2d23b6ce6f0de8d,0ce86ea054df4d1b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:27:48.515 INFO 34018 --- [ocp-schedules-11,4f4cd4da2d4d5354,d8e691feda853909] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1396,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":349,"seriesIdKeySize":349,"secondWriteQueue":0,"minuteWriteCacheSize":348} 2024-12-31 18:27:48.515 INFO 34018 --- [ocp-schedules-11,4f4cd4da2d4d5354,d8e691feda853909] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=33, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=33, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:27:48.518 INFO 34018 --- [ocp-schedules-25,12f882dc7db86169,b2ad6c92e7f5b303] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2024-12-31 18:27:48.521 INFO 34018 --- [ocp-schedules-5,97064193d9f05502,6294a77a2a21c039] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:27:48.522 INFO 34018 --- [ocp-schedules-23,8542b235070edcb7,1f764dff6f172191] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: hostQueryCache 2024-12-31 18:27:48.522 INFO 34018 --- [ocp-schedules-23,8542b235070edcb7,1f764dff6f172191] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2024-12-31 18:27:48.531 INFO 34018 --- [ocp-schedules-23,8542b235070edcb7,1f764dff6f172191] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2024-12-31 18:27:48.531 INFO 34018 --- [ocp-schedules-23,8542b235070edcb7,1f764dff6f172191] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obQueryCache 2024-12-31 18:27:48.531 INFO 34018 --- [ocp-schedules-23,8542b235070edcb7,1f764dff6f172191] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2024-12-31 18:27:48.537 INFO 34018 --- [ocp-schedules-22,1593f68db11f145e,c3577be9b3add775] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:27:48.539 INFO 34018 --- [ocp-schedules-10,9c2661cd81f7dd03,d84560c197f08552] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:27:48.541 INFO 34018 --- [ocp-schedules-23,8542b235070edcb7,1f764dff6f172191] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2024-12-31 18:27:48.541 INFO 34018 --- [ocp-schedules-23,8542b235070edcb7,1f764dff6f172191] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obProxyQueryCache 2024-12-31 18:27:48.541 INFO 34018 --- [ocp-schedules-23,8542b235070edcb7,1f764dff6f172191] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2024-12-31 18:27:48.541 INFO 34018 --- [ocp-schedules-6,8e7b3f04d4658c8b,6e4f1d2dfd5e7d5b] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:27:48.541+08:00, clusters=[] 2024-12-31 18:27:48.542 INFO 34018 --- [ocp-schedules-14,d58f1f686e7f3401,f2211d03b9653984] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:27:48.542 INFO 34018 --- [ocp-schedules-14,d58f1f686e7f3401,f2211d03b9653984] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:27:48.543 INFO 34018 --- [ocp-schedules-18,24003bc5b451307d,b6d47184d66be9d2] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:27:48.543 INFO 34018 --- [ocp-schedules-12,4b8ace9727b14ead,a4236d1c5895fff5] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:27:48.543+08:00, clusters=[] 2024-12-31 18:27:48.545 INFO 34018 --- [ocp-schedules-14,d58f1f686e7f3401,f2211d03b9653984] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:27:48.545 INFO 34018 --- [ocp-schedules-14,d58f1f686e7f3401,f2211d03b9653984] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:27:48.545 INFO 34018 --- [ocp-schedules-23,8542b235070edcb7,1f764dff6f172191] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2024-12-31 18:27:48.545 INFO 34018 --- [ocp-schedules-1,7eb50777e7635ecc,be75223383c0cf48] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[] 2024-12-31 18:27:48.546 INFO 34018 --- [ocp-schedules-1,7eb50777e7635ecc,be75223383c0cf48] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2024-12-31 18:27:48.551 INFO 34018 --- [ocp-schedules-24,d2594422eb5d1ffd,361e3d29158dca20] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:27:48.551 INFO 34018 --- [ocp-schedules-24,d2594422eb5d1ffd,361e3d29158dca20] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:27:48.557 INFO 34018 --- [ocp-schedules-27,ac816640b0696d31,eae12f2611071dbe] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:27:48.562 INFO 34018 --- [ocp-schedules-15,3fc902ae336f20e9,0f346d60bcd6b5ea] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:27:48.568 INFO 34018 --- [prometheus-minute-schedule-1,3b9cfe1932204dc9,b0981ec967f7911f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:48.578 WARN 34018 --- [ocp-async-1,18c4ace4f718a56d,d41d8853d6247b57] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:48.578 INFO 34018 --- [ocp-async-8,505dfa275b3a5fc9,6988e66d716a3399] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:48.580 INFO 34018 --- [ocp-schedules-19,db17ef8009f52f6e,706135c58f43ac8c] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:27:48.585 INFO 34018 --- [ocp-schedules-19,db17ef8009f52f6e,706135c58f43ac8c] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:27:48.585 INFO 34018 --- [ocp-schedules-19,db17ef8009f52f6e,706135c58f43ac8c] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 0 2024-12-31 18:27:48.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:27:48.589295+08:00, lastProcessTime=2024-12-31T18:27:38.589825+08:00 2024-12-31 18:27:48.651 INFO 34018 --- [ocp-schedules-4,8e80f913679cea9d,1ad4cecafc95b17f] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:27:48.651 INFO 34018 --- [ocp-schedules-4,8e80f913679cea9d,1ad4cecafc95b17f] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:27:48.654 INFO 34018 --- [ocp-schedules-4,8e80f913679cea9d,1ad4cecafc95b17f] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:27:48.654 INFO 34018 --- [ocp-schedules-4,8e80f913679cea9d,1ad4cecafc95b17f] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:27:48.655 INFO 34018 --- [ocp-schedules-4,8e80f913679cea9d,1ad4cecafc95b17f] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:27:48.655 INFO 34018 --- [ocp-schedules-4,8e80f913679cea9d,1ad4cecafc95b17f] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730651867074035712 2024-12-31 18:27:48.780 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:27:48.589295+08:00 2024-12-31 18:27:49.144 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:49.146 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:49.151 INFO 34018 --- [ocp-schedules-11,bd01d0556aa01106,9650895390fc7ff2] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:27:49.161 INFO 34018 --- [ocp-schedules-11,bd01d0556aa01106,9650895390fc7ff2] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:27:49.161 INFO 34018 --- [ocp-schedules-11,bd01d0556aa01106,9650895390fc7ff2] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:27:50.578 WARN 34018 --- [ocp-async-8,7205ff9cbcf8391c,500de2676882deeb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:50.579 INFO 34018 --- [ocp-async-9,18ebc74456aa317c,d36fefedaa55bea2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:51.271 INFO 34018 --- [ocp-schedules-17,e6cab0b8e45ee905,edd69b9641ba7c05] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:27:51.568 INFO 34018 --- [prometheus-minute-schedule-1,6a60000342eb9bda,fbbf52e7cd0ed58c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:51.890 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:27:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:27:52.146 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:52.147 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:52.578 WARN 34018 --- [ocp-async-9,ae32bdd4cb65ad8e,39fe31c4c5e913a8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:52.579 INFO 34018 --- [ocp-async-5,a6d51b739e72ad60,3b636b16ef93842e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:54.568 INFO 34018 --- [prometheus-minute-schedule-1,c16c75f1fc4401ba,f3492eefef841c9a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:54.579 WARN 34018 --- [ocp-async-1,8a8c658ce4c1be0d,b3318ae566732826] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:54.579 INFO 34018 --- [ocp-async-10,025dfa112677237f,b3b970f16bd64041] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:55.148 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:55.149 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:56.579 WARN 34018 --- [ocp-async-8,98d3ba9e4ad67469,ea79e2f12cb5fde6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:56.579 INFO 34018 --- [ocp-async-3,f34c60e6c7572147,52f3d047b22fc619] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:57.568 INFO 34018 --- [prometheus-minute-schedule-1,67449e6eb89f77e5,fcfcbda2b535a58b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640880, interval=60 2024-12-31 18:27:58.150 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:27:58.151 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:27:58.496 INFO 34018 --- [ocp-async-4,7068dec00f251b50,758172062a16281b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:27:58.521 INFO 34018 --- [ocp-schedules-20,57d79793426aff08,1a200bcd282a5b45] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:27:58.579 WARN 34018 --- [ocp-async-2,23b39b40e374a896,c36691ac1c9fa600] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:27:58.583 INFO 34018 --- [ocp-async-1,18d1a0d456cf6934,2c463ac2f3e6c5dc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:27:58.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:27:58.589085+08:00, lastProcessTime=2024-12-31T18:27:48.589295+08:00 2024-12-31 18:27:58.749 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:27:58.589085+08:00 2024-12-31 18:28:00.568 INFO 34018 --- [prometheus-minute-schedule-1,b55f0738919f98ea,29ab3e3c56dc1438] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:00.579 WARN 34018 --- [ocp-async-10,93eb522a7c33cfd8,b7b01f3466473112] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:00.583 INFO 34018 --- [ocp-async-8,4990b1a5b01fa338,a114c64310e45eb6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:01.152 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:01.153 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:01.348 INFO 34018 --- [ocp-schedules-10,38a1f9df536979a2,8e595a75e16c2e28] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:28:02.579 WARN 34018 --- [ocp-async-3,6566f136d88634f0,e35ec1afe0e82e96] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:02.583 INFO 34018 --- [ocp-async-9,4d43c6e83322d1e3,085291925642bbb5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:03.568 INFO 34018 --- [prometheus-minute-schedule-1,08a11ee31198abdf,e811778c50099167] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:04.153 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:04.155 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:04.161 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2024-12-31 18:28:04.164 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=3ms, period=120000ms 2024-12-31 18:28:04.579 WARN 34018 --- [ocp-async-4,e2357b3a55d3c462,c0dcf575fd8afd5b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:04.583 INFO 34018 --- [ocp-async-5,ba781d0573ca0295,deddf3f4e9bd7a49] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:06.568 INFO 34018 --- [prometheus-minute-schedule-1,51560bb223357858,3bc9f9b69174a9ad] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:06.580 WARN 34018 --- [ocp-async-1,736b4dd2ef4194ce,3d125f222bb5f207] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:06.583 INFO 34018 --- [ocp-async-7,149b4eb99fa3396c,ea10936228c4851b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:07.155 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:07.158 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:08.496 INFO 34018 --- [ocp-async-7,d62d207d5e73b616,7c3bc9f69a40fa3a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:28:08.521 INFO 34018 --- [ocp-schedules-23,bb1fe54919f259f2,64b90d5e7dd97a76] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:28:08.580 WARN 34018 --- [ocp-async-3,8008ba812c9c2867,5f4e0e170ab7639c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:08.584 INFO 34018 --- [ocp-async-9,c1c8d97f6231f97b,c3f8e2114f48999d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:08.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:28:08.590020+08:00, lastProcessTime=2024-12-31T18:27:58.589085+08:00 2024-12-31 18:28:08.764 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:28:08.590020+08:00 2024-12-31 18:28:09.164 INFO 34018 --- [ocp-schedules-24,710a128cf7edfc90,6b14e7e6d4af9623] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:28:09.174 INFO 34018 --- [ocp-schedules-24,710a128cf7edfc90,6b14e7e6d4af9623] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:28:09.174 INFO 34018 --- [ocp-schedules-24,710a128cf7edfc90,6b14e7e6d4af9623] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:28:09.568 INFO 34018 --- [prometheus-minute-schedule-1,5d713fa243322cd2,b1d1fc728833ac42] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:10.003 INFO 34018 --- [ocp-schedules-1,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:28:10.003 INFO 34018 --- [ocp-schedules-9,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:28:10.158 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:10.160 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:10.580 WARN 34018 --- [ocp-async-4,ee06fd06f71a9244,a67ecfb5949432be] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:10.584 INFO 34018 --- [ocp-async-5,4ef1a09627ae9a81,401a0efb9591a711] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:10.889 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-12-31 18:28:10.908 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-12-31 18:28:11.397 INFO 34018 --- [ocp-schedules-22,cbcea5a7e06f71bb,ed4dff65a307d5cd] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:28:12.568 INFO 34018 --- [prometheus-minute-schedule-1,aae1a378caf30ce5,1a1bf24e783e1015] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:12.569 INFO 34018 --- [prometheus-hour-schedule-1,e7f8c974e93d9df5,0a22af263946ea31] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:28:12.580 WARN 34018 --- [ocp-async-10,7ae8f3f7d2d577b8,34007a91d501db0f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:12.584 INFO 34018 --- [ocp-async-7,d124dd2bbcbc8309,cc0ea8792fb037b6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:12.656 INFO 34018 --- [metric-archive-second-16,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640820, nodeCount=13, affectRows=13 2024-12-31 18:28:12.656 INFO 34018 --- [metric-archive-second-16,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640820, nodeCount=13, validCount=13 2024-12-31 18:28:12.658 INFO 34018 --- [metric-archive-second-27,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640820, nodeCount=30, affectRows=30 2024-12-31 18:28:12.658 INFO 34018 --- [metric-archive-second-24,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640820, nodeCount=27, affectRows=27 2024-12-31 18:28:12.658 INFO 34018 --- [metric-archive-second-34,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640820, nodeCount=15, affectRows=15 2024-12-31 18:28:12.658 INFO 34018 --- [metric-archive-second-22,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640820, nodeCount=30, affectRows=30 2024-12-31 18:28:12.658 INFO 34018 --- [metric-archive-second-34,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640820, nodeCount=15, validCount=15 2024-12-31 18:28:12.658 INFO 34018 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640820, nodeCount=37, affectRows=37 2024-12-31 18:28:12.658 INFO 34018 --- [metric-archive-second-24,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640820, nodeCount=27, validCount=27 2024-12-31 18:28:12.658 INFO 34018 --- [metric-archive-second-27,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640820, nodeCount=30, validCount=30 2024-12-31 18:28:12.658 INFO 34018 --- [metric-archive-second-22,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640820, nodeCount=29, validCount=29 2024-12-31 18:28:12.658 INFO 34018 --- [metric-archive-second-2,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640820, nodeCount=37, validCount=37 2024-12-31 18:28:12.662 INFO 34018 --- [metric-archive-second-23,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640820, nodeCount=197, affectRows=197 2024-12-31 18:28:12.663 INFO 34018 --- [metric-archive-second-23,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640820, nodeCount=197, validCount=197 2024-12-31 18:28:13.160 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:13.162 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:14.581 WARN 34018 --- [ocp-async-3,d0797dcfba316d25,698c07cc3e3ad0cd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:14.584 INFO 34018 --- [ocp-async-6,afcd5800fa4f5890,84c689afb7296a75] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:15.568 INFO 34018 --- [prometheus-minute-schedule-1,f36f12eafc506bd6,908c6c79406c4d10] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:16.163 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:16.165 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:16.581 WARN 34018 --- [ocp-async-9,365dd06f91bcb082,92e550f6fdb6379c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:16.584 INFO 34018 --- [ocp-async-2,8ad84dc4d6b84f61,691f66111aceab8d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:17.127 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,6fa55e03fb2ca0de,73c23d3695ff6e6a] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=6fa55e03fb2ca0de, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:28:17.127 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,1ecbe0ddc8dc3c9a,dcd04e323dbef2a0] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=1ecbe0ddc8dc3c9a, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:28:17.127 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,7d6e9c5b202276a6,5586fbc0f51649e9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=7d6e9c5b202276a6, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:28:17.127 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,2be627b438d7726d,b0263e8c4d4863f9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=2be627b438d7726d, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:28:17.130 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,7d6e9c5b202276a6,5586fbc0f51649e9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=7d6e9c5b202276a6, duration=22 ms] 2024-12-31 18:28:17.130 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,2be627b438d7726d,b0263e8c4d4863f9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=2be627b438d7726d, duration=21 ms] 2024-12-31 18:28:17.130 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,1ecbe0ddc8dc3c9a,dcd04e323dbef2a0] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=1ecbe0ddc8dc3c9a, duration=14 ms] 2024-12-31 18:28:17.134 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,6fa55e03fb2ca0de,73c23d3695ff6e6a] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=6fa55e03fb2ca0de, duration=26 ms] 2024-12-31 18:28:18.457 INFO 34018 --- [ocp-schedules-18,221768a6623a2ad6,36b21d477b207985] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:28:18.458 INFO 34018 --- [ocp-schedules-7,a5803d676f05d3e8,5e1152efe4c4d8fc] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:28:18.458 INFO 34018 --- [ocp-schedules-26,bb151e4f2bd0d46b,6ba21ad47c4a078e] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:28:18.458 INFO 34018 --- [ocp-schedules-9,bbfe21ff1f036247,0b96d7e5785dcee7] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:28:18.465 INFO 34018 --- [ocp-schedules-10,44ae64911ce45ea9,103c211ff225eb41] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:28:18.471 INFO 34018 --- [ocp-schedules-16,5da9d03daa5bfa99,c4274b8c73a1331d] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:28:18.471 INFO 34018 --- [ocp-schedules-16,5da9d03daa5bfa99,c4274b8c73a1331d] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:28:18.471 INFO 34018 --- [ocp-schedules-20,40be32476cf3db58,6935300b056b11ab] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:28:18.472 INFO 34018 --- [ocp-schedules-20,40be32476cf3db58,6935300b056b11ab] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:28:18.472 INFO 34018 --- [ocp-schedules-24,d5553407de6d62bd,9d7623422ab887f2] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:28:18.472 INFO 34018 --- [ocp-schedules-24,d5553407de6d62bd,9d7623422ab887f2] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:28:18.496 INFO 34018 --- [ocp-async-2,298ae48656bff70a,1ec40194e95b1007] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:28:18.522 INFO 34018 --- [ocp-schedules-2,5c57f7e6e17ce543,ed3c5af76c325edf] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:28:18.565 INFO 34018 --- [ocp-schedules-14,6604eae5c408d193,6ec7db211db47d9f] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:28:18.568 INFO 34018 --- [prometheus-minute-schedule-1,a151cd1742d56b9e,a0ead66657587068] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:18.581 WARN 34018 --- [ocp-async-10,f3cc5b2fbfdc59cd,64363cafb1e13dc8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:18.584 INFO 34018 --- [ocp-async-7,3e8b5427131785a9,494108ec7b0f53cf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:18.588 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:28:18.588046+08:00, lastProcessTime=2024-12-31T18:28:08.590020+08:00 2024-12-31 18:28:18.741 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:28:18.588046+08:00 2024-12-31 18:28:19.165 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:19.167 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:19.646 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,702a569b10788514,2b5974b1c066dd57] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/stats/topAvgCompactionDuration?limit=5&inDays=3, client=10.108.139.108, traceId=702a569b10788514, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObClusterStatsController.getClustersTopAvgCompactionDuration(Integer,Integer), args=3,5,] 2024-12-31 18:28:19.646 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,bb5c115041c6b9f5,69a865a19be24371] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/tenants/topAvgCompactionDuration?limit=5&inDays=7, client=10.108.139.108, traceId=bb5c115041c6b9f5, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObTenantCompactionController.topAvgCompactionDuration(Integer,Integer), args=7,5,] 2024-12-31 18:28:19.648 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,9f38ffb5edfb3015,07ae166e5a06f3ba] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/alarmSummaries?null, client=10.108.139.108, traceId=9f38ffb5edfb3015, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObClusterController.listClusterAlarmSummaries(String,List), args=] 2024-12-31 18:28:19.648 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,702a569b10788514,2b5974b1c066dd57] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/stats/topAvgCompactionDuration client=10.108.139.108, traceId=702a569b10788514, duration=9 ms] 2024-12-31 18:28:19.648 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,bb5c115041c6b9f5,69a865a19be24371] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/tenants/topAvgCompactionDuration client=10.108.139.108, traceId=bb5c115041c6b9f5, duration=8 ms] 2024-12-31 18:28:19.648 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,572ea9eda96fa783,be4ba6903472221b] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/metricGroups?scope=CLUSTER&type=TOP, client=10.108.139.108, traceId=572ea9eda96fa783, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.MonitorController.listMetricClasses(Pageable,MetricType,MetricScope,Long), args=Page request [number: 0, size 5000, sort: id: ASC],TOP,CLUSTER,] 2024-12-31 18:28:19.659 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,9f38ffb5edfb3015,07ae166e5a06f3ba] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/alarmSummaries client=10.108.139.108, traceId=9f38ffb5edfb3015, duration=21 ms] 2024-12-31 18:28:19.685 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,572ea9eda96fa783,be4ba6903472221b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/metricGroups client=10.108.139.108, traceId=572ea9eda96fa783, duration=47 ms] 2024-12-31 18:28:20.253 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,d657aa65a9aecee5,9da9c8d2266c352a] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clustersView?page=1&size=10&sort=name%2Casc, client=10.108.139.108, traceId=d657aa65a9aecee5, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObClusterController.listObClustersView(String,List,WithRemote,List,Pageable), args=NONE,Page request [number: 0, size 10, sort: name: ASC],] 2024-12-31 18:28:20.283 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,d657aa65a9aecee5,9da9c8d2266c352a] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clustersView client=10.108.139.108, traceId=d657aa65a9aecee5, duration=48 ms] 2024-12-31 18:28:20.581 WARN 34018 --- [ocp-async-3,2bddf39690d55d5d,76fdeecb31d6ed43] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:20.585 INFO 34018 --- [ocp-async-6,eb13d5128cd89f66,89cca436c047d2e7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:20.753 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,597b5a7f89ad5ae0,83225f4e7cac7fb5] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/top?labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id&metrics=sql_all_count&limit=5&startTime=2024-12-31T17%3A28%3A20%2B08%3A00&endTime=2024-12-31T18%3A28%3A20%2B08%3A00&maxPoints=360, client=10.108.139.108, traceId=597b5a7f89ad5ae0, method=IterableResponse com.oceanbase.ocp.server.common.controller.MonitorController.queryMetricTop(OffsetDateTime,OffsetDateTime,String,String,Long,Long,Integer,Integer,String,Boolean), args=2024-12-31T17:28:20+08:00,2024-12-31T18:28:20+08:00,sql_all_count,app,ob_cluster_name,ob_cluster_id,0,0,5,360,app:OB,true,] 2024-12-31 18:28:20.764 WARN 34018 --- [http-nio-0.0.0.0-8090-exec-6,597b5a7f89ad5ae0,83225f4e7cac7fb5] c.o.o.m.s.MonitorAsyncComputeServiceImpl : Scan data async cannot find recordId. metric = sql_all_count, labels = app="OB", groupBy = app,ob_cluster_name,ob_cluster_id, interval = 30 2024-12-31 18:28:20.770 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,597b5a7f89ad5ae0,83225f4e7cac7fb5] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/top client=10.108.139.108, traceId=597b5a7f89ad5ae0, duration=35 ms] 2024-12-31 18:28:21.444 INFO 34018 --- [ocp-schedules-30,190f27f9be70e4ab,e53785be95fac014] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:28:21.568 INFO 34018 --- [prometheus-minute-schedule-1,3276b5865b895f26,237c72e970590142] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:22.167 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:22.169 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:22.567 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,5fffd9c35125d065,ee2097388579c071] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=10.108.139.108, traceId=5fffd9c35125d065, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ProfileController.userInfo(), args=] 2024-12-31 18:28:22.567 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6bb76e08a2c3fc06,136069a3eda43059] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=10.108.139.108, traceId=6bb76e08a2c3fc06, method=SuccessResponse com.oceanbase.ocp.server.common.controller.PropertyController.getSystemInfo(), args=] 2024-12-31 18:28:22.567 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6bb76e08a2c3fc06,136069a3eda43059] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=10.108.139.108, traceId=6bb76e08a2c3fc06, duration=8 ms] 2024-12-31 18:28:22.572 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,6b09be316993ade2,163e1b307fdfe283] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/state-statistics?null, client=10.108.139.108, traceId=6b09be316993ade2, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskStateSummary(TaskType), args=MANUAL,] 2024-12-31 18:28:22.576 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,5fffd9c35125d065,ee2097388579c071] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=10.108.139.108, traceId=5fffd9c35125d065, duration=17 ms] 2024-12-31 18:28:22.576 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,15aa1fbc140e775f,883d610a8986c25e] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/alarm/alarms/actived?null, client=10.108.139.108, traceId=15aa1fbc140e775f, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.AlarmController.fetchActivedAlarms(String,String,List,String,List,List,List,OffsetDateTime,OffsetDateTime,String,Pageable), args=Page request [number: 0, size 10, sort: id: DESC],] 2024-12-31 18:28:22.581 WARN 34018 --- [ocp-async-9,dff728c7ed30317d,f5473225a7c86897] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:22.585 INFO 34018 --- [ocp-async-2,a000c842a16294e1,400df00cda0659e7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:22.597 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,6b09be316993ade2,163e1b307fdfe283] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/state-statistics client=10.108.139.108, traceId=6b09be316993ade2, duration=32 ms] 2024-12-31 18:28:22.736 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,15aa1fbc140e775f,883d610a8986c25e] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/alarms/actived client=10.108.139.108, traceId=15aa1fbc140e775f, duration=169 ms] 2024-12-31 18:28:24.232 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,1e258913573a69d9,28056857f9f60cb9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/telemetry?null, client=10.108.139.108, traceId=1e258913573a69d9, method=SuccessResponse com.oceanbase.ocp.controller.TelemetryController.get(), args=] 2024-12-31 18:28:24.236 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,1e258913573a69d9,28056857f9f60cb9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/telemetry client=10.108.139.108, traceId=1e258913573a69d9, duration=12 ms] 2024-12-31 18:28:24.568 INFO 34018 --- [prometheus-minute-schedule-1,42f374df32fdb24c,e2111c20a3108760] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:24.581 WARN 34018 --- [ocp-async-10,67bb807e8e768bd8,a7613d3524586eb6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:24.585 INFO 34018 --- [ocp-async-1,7987d1d06b67b346,48ebdda54cb7826f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:24.603 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,5d6e0cefbeea64f6,44a655071539a29e] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/info?null, client=10.108.139.108, traceId=5d6e0cefbeea64f6, method=OcpBuildInfo com.oceanbase.ocp.server.common.controller.InfoController.info(), args=] 2024-12-31 18:28:24.603 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,384b936bcc361fa6,181999a06ae0207b] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/sensitiveDataKey?null, client=10.108.139.108, traceId=384b936bcc361fa6, method=SuccessResponse com.oceanbase.ocp.server.common.controller.InfoController.getSensitiveDataPublicKey(), args=] 2024-12-31 18:28:24.603 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,5d6e0cefbeea64f6,44a655071539a29e] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/info client=10.108.139.108, traceId=5d6e0cefbeea64f6, duration=5 ms] 2024-12-31 18:28:24.603 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,384b936bcc361fa6,181999a06ae0207b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/sensitiveDataKey client=10.108.139.108, traceId=384b936bcc361fa6, duration=6 ms] 2024-12-31 18:28:24.604 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,3e4b9b0544d05720,c77e26556806ba51] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=10.108.139.108, traceId=3e4b9b0544d05720, method=OffsetDateTime com.oceanbase.ocp.server.common.controller.InfoController.time(), args=] 2024-12-31 18:28:24.604 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,3e4b9b0544d05720,c77e26556806ba51] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=10.108.139.108, traceId=3e4b9b0544d05720, duration=5 ms] 2024-12-31 18:28:24.777 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=10.108.139.108, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2024-12-31 18:28:24.777 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=10.108.139.108, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2024-12-31 18:28:24.777 WARN 34018 --- [http-nio-0.0.0.0-8090-exec-10,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/mc/info, method=10.108.139.108, client=GET, traceId=] 2024-12-31 18:28:24.777 WARN 34018 --- [http-nio-0.0.0.0-8090-exec-5,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/maz/state, method=10.108.139.108, client=GET, traceId=] 2024-12-31 18:28:24.777 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=10.108.139.108, traceId=, duration=0 ms] 2024-12-31 18:28:24.777 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=10.108.139.108, traceId=, duration=0 ms] 2024-12-31 18:28:25.170 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:25.171 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:26.582 WARN 34018 --- [ocp-async-7,778fde3bf9a3e3e0,a679c2cb3e7cbc71] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:26.585 INFO 34018 --- [ocp-async-8,08f3c746c8edb58d,91632d531e2fb2da] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:27.568 INFO 34018 --- [prometheus-minute-schedule-1,e56ecd060fb8fedf,cc6fde734744360d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:28.172 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:28.174 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:28.496 INFO 34018 --- [ocp-async-8,0742da99db5e6d30,c93ecb5ee5f57ce6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:28:28.522 INFO 34018 --- [ocp-schedules-13,0a18e96036830478,f0a23f37eed127a2] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:28:28.582 WARN 34018 --- [ocp-async-9,a3103a6aea42d08f,334a7dd50014e9d6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:28.585 INFO 34018 --- [ocp-async-2,51803f5758a31839,595ea0de376d36e5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:28.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:28:28.589882+08:00, lastProcessTime=2024-12-31T18:28:18.588046+08:00 2024-12-31 18:28:28.767 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:28:28.589882+08:00 2024-12-31 18:28:29.177 INFO 34018 --- [ocp-schedules-14,a0ecaf9def337eaf,c38b8db86f6874b1] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:28:29.187 INFO 34018 --- [ocp-schedules-14,a0ecaf9def337eaf,c38b8db86f6874b1] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:28:29.187 INFO 34018 --- [ocp-schedules-14,a0ecaf9def337eaf,c38b8db86f6874b1] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:28:30.568 INFO 34018 --- [prometheus-minute-schedule-1,a2698c39350ef08c,c292a487359a3786] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:30.582 WARN 34018 --- [ocp-async-10,743144c8731630cc,78c12e3d1038b880] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:30.585 INFO 34018 --- [ocp-async-1,cae13ca07b0d9b73,0b54f0bf96a21722] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:31.174 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:31.176 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:31.486 INFO 34018 --- [ocp-schedules-29,016362b16d2a81df,bd8983b5ea10e2fa] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:28:32.582 WARN 34018 --- [ocp-async-3,f8113ea6c20105df,d82b1765f3cbede9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:32.586 INFO 34018 --- [ocp-async-8,174f791bde2253c3,cd1ba643add8faac] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:33.568 INFO 34018 --- [prometheus-minute-schedule-1,67a0c612765953d8,0f09576fe6224f99] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:34.176 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:34.178 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:34.582 WARN 34018 --- [ocp-async-8,10a5fb46c21cf320,d74c9c1c5af766d2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:34.586 INFO 34018 --- [ocp-async-4,e83f396d1f0fee87,95c205d259dd1de5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:36.568 INFO 34018 --- [prometheus-minute-schedule-1,63ee98329d133ef0,72cfa31ac33eadb4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:36.569 INFO 34018 --- [prometheus-cache-monitor1,e3ca329503659de4,ee0f98c9bc2d61d2] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1396,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":355,"seriesIdKeySize":355,"secondWriteQueue":0,"minuteWriteCacheSize":348} 2024-12-31 18:28:36.569 INFO 34018 --- [prometheus-cache-monitor1,e3ca329503659de4,ee0f98c9bc2d61d2] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=36, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=36, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:28:36.583 WARN 34018 --- [ocp-async-2,b2423fe043ad046a,c533d28df31e1180] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:36.586 INFO 34018 --- [ocp-async-10,16e07131e5c0224c,beb279ca45e7cb21] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:36.646 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2024-12-31T18:24:36.615, end=2024-12-31T18:26:36.643} 2024-12-31 18:28:36.649 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [] 2024-12-31 18:28:36.649 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2024-12-31 18:28:37.179 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:37.181 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:38.497 INFO 34018 --- [ocp-async-10,19e5b70c3503b887,2b2e622d721c898d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:28:38.522 INFO 34018 --- [ocp-schedules-15,5076918a45a2f9d6,56f0e34c880f49b0] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:28:38.583 WARN 34018 --- [ocp-async-3,4f39161652ad626f,058071150561ad2f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:38.586 INFO 34018 --- [ocp-async-7,d46468a6b973731b,dfa86e3923df4da9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:38.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:28:38.587965+08:00, lastProcessTime=2024-12-31T18:28:28.589882+08:00 2024-12-31 18:28:38.752 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:28:38.587965+08:00 2024-12-31 18:28:39.568 INFO 34018 --- [prometheus-minute-schedule-1,47a79e44a9105dd9,e0b5146ae33bd123] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:40.004 INFO 34018 --- [ocp-schedules-9,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:28:40.004 INFO 34018 --- [ocp-schedules-29,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:28:40.181 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:40.183 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:40.583 WARN 34018 --- [ocp-async-7,083e621fcefd7ac7,3b66a2f5d66c6936] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:40.586 INFO 34018 --- [ocp-async-6,0394e4a607f82c8f,f77d327021b2601f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:41.533 INFO 34018 --- [ocp-schedules-1,89f55b2621384333,c8a9cd28f0518f28] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:28:42.568 INFO 34018 --- [prometheus-minute-schedule-1,abbb4d78d50a97a4,45fa99aa6cdc8390] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:42.583 WARN 34018 --- [ocp-async-5,bd393915ef9c329c,3c8ce1052ea0a0bf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:42.587 INFO 34018 --- [ocp-async-4,ad4136649a1e3dbc,ecfaf4cf4d65ede1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:43.183 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:43.185 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:44.583 WARN 34018 --- [ocp-async-10,7ff57b65cd6682e5,159dd5b7bae16f3b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:44.587 INFO 34018 --- [ocp-async-1,87b244ea63a69af2,339d2bd88969c7cf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:45.568 INFO 34018 --- [prometheus-minute-schedule-1,f6ccbfed88930308,ebb13c2ce6a94f4d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:46.185 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:46.188 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:46.583 WARN 34018 --- [ocp-async-8,4566001387eb5a55,36ff977813582908] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:46.587 INFO 34018 --- [ocp-async-9,7408bf8000f53261,d0064ddcfcb4ed44] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:48.456 INFO 34018 --- [ocp-schedules-19,98b36bd8ad045339,713e00aa0dd99243] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:28:48.457 INFO 34018 --- [ocp-schedules-24,94ea35f26cb0729a,f8136754f3016143] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:28:48.457 INFO 34018 --- [ocp-schedules-2,44d9704233a81d14,e8d50d0b4f6cdcf9] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:28:48.458 INFO 34018 --- [ocp-schedules-29,56416395cfd0465f,c0a00ea309808aee] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:28:48.458 INFO 34018 --- [ocp-schedules-23,7e8ee56b2b73828f,f7e7a61facc371a0] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:28:48.458 INFO 34018 --- [ocp-schedules-13,db7e7e8e5aa1331c,e5f1aedf046b48fd] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:28:48.464 INFO 34018 --- [ocp-schedules-19,98b36bd8ad045339,713e00aa0dd99243] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:28:48.465 INFO 34018 --- [ocp-schedules-14,68567935376d74b8,0bbfa4f89812055e] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:28:48.466 INFO 34018 --- [ocp-schedules-23,7e8ee56b2b73828f,f7e7a61facc371a0] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:28:48.471 INFO 34018 --- [ocp-schedules-30,62e2f81a6c13433e,cd547b30e9c11af1] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:28:48.471 INFO 34018 --- [ocp-schedules-17,8e6c12e280688374,738e001177461a45] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:28:48.471 INFO 34018 --- [ocp-schedules-17,8e6c12e280688374,738e001177461a45] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:28:48.471 INFO 34018 --- [ocp-schedules-30,62e2f81a6c13433e,cd547b30e9c11af1] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:28:48.472 INFO 34018 --- [ocp-schedules-28,1ec36eb6bd24419a,1362ff9527a5cf99] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:28:48.472 INFO 34018 --- [ocp-schedules-28,1ec36eb6bd24419a,1362ff9527a5cf99] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:28:48.497 INFO 34018 --- [ocp-async-5,b00a9c0e68a165fe,2327ff5e2cfaf759] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:28:48.522 INFO 34018 --- [ocp-schedules-16,777a9328c478923c,7a5135504257b8f7] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:28:48.542 INFO 34018 --- [ocp-schedules-15,a4fd45171c23f140,38c9753968cd9dd3] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:28:48.543 INFO 34018 --- [ocp-schedules-25,99352f7fc4f1e682,1a3ea9af7686a76a] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:28:48.544 INFO 34018 --- [ocp-schedules-5,2d1e7592cfa70ee4,f91bfcdd18b9e49a] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:28:48.544+08:00, clusters=[] 2024-12-31 18:28:48.545 INFO 34018 --- [ocp-schedules-26,9798b50f2c192228,81dfe1a9d37252ae] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:28:48.545 INFO 34018 --- [ocp-schedules-26,9798b50f2c192228,81dfe1a9d37252ae] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:28:48.546 INFO 34018 --- [ocp-schedules-20,04bbcdc15900edc8,97e8c77a85d535f3] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:28:48.546 INFO 34018 --- [ocp-schedules-27,b4a5ebac27967dc8,29882a99f2a4c52a] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:28:48.546+08:00, clusters=[] 2024-12-31 18:28:48.547 INFO 34018 --- [ocp-schedules-26,9798b50f2c192228,81dfe1a9d37252ae] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:28:48.547 INFO 34018 --- [ocp-schedules-26,9798b50f2c192228,81dfe1a9d37252ae] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:28:48.554 INFO 34018 --- [ocp-schedules-6,ecd26a129bb4213b,7b04d020e2340d69] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:28:48.554 INFO 34018 --- [ocp-schedules-6,ecd26a129bb4213b,7b04d020e2340d69] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:28:48.555 INFO 34018 --- [ocp-schedules-10,457a34ef9e9c9135,1750c14d6be3f444] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[] 2024-12-31 18:28:48.555 INFO 34018 --- [ocp-schedules-10,457a34ef9e9c9135,1750c14d6be3f444] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2024-12-31 18:28:48.561 INFO 34018 --- [ocp-schedules-13,dccac8feef8890f8,272d03b8b4687950] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:28:48.567 INFO 34018 --- [ocp-schedules-24,8843849357aba521,176c9c8614475377] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:28:48.568 INFO 34018 --- [prometheus-minute-schedule-1,f7c5d04698bb332c,a34820ad819ecd34] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:48.584 WARN 34018 --- [ocp-async-10,43218a51e65fcd43,ede4d8a81d3c3c15] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:48.585 INFO 34018 --- [ocp-schedules-23,9df4c50789d8ac10,a3bff6ec24624bd4] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:28:48.587 INFO 34018 --- [ocp-async-3,4f08296cac530af2,06a5033cb8ff6738] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:48.591 INFO 34018 --- [ocp-schedules-23,9df4c50789d8ac10,a3bff6ec24624bd4] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:28:48.591 INFO 34018 --- [ocp-schedules-23,9df4c50789d8ac10,a3bff6ec24624bd4] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 0 2024-12-31 18:28:48.591 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:28:48.590910+08:00, lastProcessTime=2024-12-31T18:28:38.587965+08:00 2024-12-31 18:28:48.656 INFO 34018 --- [ocp-schedules-19,a46669af9ff94092,5e0cef14a4ac318c] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:28:48.656 INFO 34018 --- [ocp-schedules-19,a46669af9ff94092,5e0cef14a4ac318c] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:28:48.658 INFO 34018 --- [ocp-schedules-19,a46669af9ff94092,5e0cef14a4ac318c] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:28:48.658 INFO 34018 --- [ocp-schedules-19,a46669af9ff94092,5e0cef14a4ac318c] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:28:48.659 INFO 34018 --- [ocp-schedules-19,a46669af9ff94092,5e0cef14a4ac318c] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:28:48.659 INFO 34018 --- [ocp-schedules-19,a46669af9ff94092,5e0cef14a4ac318c] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730651867074035712 2024-12-31 18:28:48.661 INFO 34018 --- [ocp-schedules-19,a46669af9ff94092,5e0cef14a4ac318c] c.o.ocp.monitor.service.IdKeyService : Sync record key and id, newRecordIdsCount=8, maxSyncedRecordId=730653623019405312 2024-12-31 18:28:48.761 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:28:48.590910+08:00 2024-12-31 18:28:49.188 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:49.190 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:49.190 INFO 34018 --- [ocp-schedules-4,17b175f9dcf6b93a,ab3ea0c34d90e351] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:28:49.200 INFO 34018 --- [ocp-schedules-4,17b175f9dcf6b93a,ab3ea0c34d90e351] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:28:49.200 INFO 34018 --- [ocp-schedules-4,17b175f9dcf6b93a,ab3ea0c34d90e351] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:28:50.584 WARN 34018 --- [ocp-async-1,25da094174b30116,7b71f13204b425f2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:50.587 INFO 34018 --- [ocp-async-7,46792bc67dd3d875,1aa34472a73fbae6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:51.568 INFO 34018 --- [prometheus-minute-schedule-1,ecbf384cea9dd282,6e6d34b591c5bb1e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:51.571 INFO 34018 --- [ocp-schedules-29,abd045ea77e27f00,ccac67501141f4e0] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:28:51.889 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:28:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:28:52.190 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:52.192 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:52.584 WARN 34018 --- [ocp-async-2,ce1352eb351dadca,d89ccd9f1daddf68] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:52.587 INFO 34018 --- [ocp-async-5,0b2abfe1a16e566d,a375365a385e75c9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:54.156 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2024-12-31 18:28:54.156 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.ocp.core.property.PropertyService : Refresh config properties 2024-12-31 18:28:54.163 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:28:54.163 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:28:54.163 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:28:54.164 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:28:54.169 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:28:54.169 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:28:54.169 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:28:54.170 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:28:54.204 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:28:54.212 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:28:54.212 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:28:54.212 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:28:54.212 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:28:54.212 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:28:54.219 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:28:54.568 INFO 34018 --- [prometheus-minute-schedule-1,2c6403d5edd83ca9,01343cd56763171a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:54.584 WARN 34018 --- [ocp-async-5,7bfc1da543efc0c3,205a62885691f6a5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:54.588 INFO 34018 --- [ocp-async-4,22b09c6290dc883a,abfbda540c20d7f2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:54.755 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2024-12-31 18:28:55.192 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:55.194 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:55.246 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT1.077056053S 2024-12-31 18:28:55.247 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:28:55.335 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2024-12-31 18:28:55.335 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2024-12-31 18:28:55.368 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 2024-12-31 18:28:55.421 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:28:55.422 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:28:55.422 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:28:55.422 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:28:55.422 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:28:55.422 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2024-12-31 18:28:55.431 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:28:55.581 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] o.s.boot.SpringApplication : Started application in 1.417 seconds (JVM running for 691.429) 2024-12-31 18:28:55.581 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT1.417846051S 2024-12-31 18:28:56.005 INFO 34018 --- [ocp-schedules-16,08b5baa6540657d8,a47b31cd61323353] c.o.ocp.core.property.PropertyService : Refresh config properties done 2024-12-31 18:28:56.584 WARN 34018 --- [ocp-async-1,261b6a7aed18266e,c8b28db0b1e260e9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:56.588 INFO 34018 --- [ocp-async-8,f96677c0567af33f,ebed56e026beea65] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:57.568 INFO 34018 --- [prometheus-minute-schedule-1,d2b845f4f782cfd7,4dac5e833493306f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735640940, interval=60 2024-12-31 18:28:58.194 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:28:58.196 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:28:58.497 INFO 34018 --- [ocp-async-7,5b59c1c2f8a2983a,8caa813a47bd5a46] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:28:58.522 INFO 34018 --- [ocp-schedules-6,4e58541763a52aa3,cbe56daf69be6b70] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:28:58.585 WARN 34018 --- [ocp-async-9,63ee7eaef8668081,85f74058c2f088e5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:28:58.588 INFO 34018 --- [ocp-async-5,18e2a49743c380bf,2804b28d84811c67] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:28:58.593 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:28:58.589554+08:00, lastProcessTime=2024-12-31T18:28:48.590910+08:00 2024-12-31 18:28:58.768 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:28:58.589554+08:00 2024-12-31 18:29:00.568 INFO 34018 --- [prometheus-minute-schedule-1,5a23cc9e141dcd7c,9d8fc9ddd5e8b634] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:00.585 WARN 34018 --- [ocp-async-4,f59ff4b9f61c1f80,2479bcedea18fde1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:00.588 INFO 34018 --- [ocp-async-1,5119571d3f8fe539,c86acc9b25ea07eb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:01.196 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:01.198 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:01.613 INFO 34018 --- [ocp-schedules-28,1aef96719e4f4f07,2962e4cf7eaaf5b1] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:29:02.585 WARN 34018 --- [ocp-async-8,80504261380df583,24e8a9e8c900cccb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:02.588 INFO 34018 --- [ocp-async-7,c7e6f9c5153a6d69,9d6459785c85a9b0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:03.568 INFO 34018 --- [prometheus-minute-schedule-1,5d877a005ac0f465,43e6ec07a5f17ca7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:04.198 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:04.201 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:04.585 WARN 34018 --- [ocp-async-9,bb34ee6fdc3ad995,a7dfe917268615ed] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:04.589 INFO 34018 --- [ocp-async-6,c1231cfe7734b3ff,0a49594a1dc144c9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:06.568 INFO 34018 --- [prometheus-minute-schedule-1,4da2873916061045,44be0ce7f0b0c90f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:06.585 WARN 34018 --- [ocp-async-4,726c5b5c5e8bddd4,2eca71cc475f8357] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:06.589 INFO 34018 --- [ocp-async-5,be63cfc6cef0b00a,a9b03afbbdcacab4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:07.201 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:07.203 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:08.497 INFO 34018 --- [ocp-async-5,e94c4bbb425a71f1,df9a8540871d89c4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:29:08.522 INFO 34018 --- [ocp-schedules-15,00026c1bbf998c57,e946cc5548e04ab2] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:29:08.586 WARN 34018 --- [ocp-async-3,55a5ee732664ca5c,7ea81ebdfea80e9b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:08.589 INFO 34018 --- [ocp-async-7,de4cae2cf9008dcd,22ca44f4ac466623] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:08.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:29:08.589606+08:00, lastProcessTime=2024-12-31T18:28:58.589554+08:00 2024-12-31 18:29:08.755 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:29:08.589606+08:00 2024-12-31 18:29:09.124 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.o.s.c.c.s.utils.CsrfRequestMatcher : CSRF token required for API [POST /api/v2/ob/clusters/takeOverPreCheck, client 10.108.139.108, traceId 6ee89db68b33ad4f] 2024-12-31 18:29:09.203 INFO 34018 --- [ocp-schedules-29,1007d8499a679874,5e98a9a44c50fb6f] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:29:09.210 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /api/v2/ob/clusters/takeOverPreCheck?null, client=10.108.139.108, traceId=6ee89db68b33ad4f, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ObClusterController.takeOverClusterPreCheck(TakeOverClusterPreCheckParam), args=TakeOverClusterPreCheckParam(connectionMode=proxy, clusterName=myoceanbase, vpcName=null, vpcId=1, obClusterId=null, rootSyspassword=xxx proxyropassword=xxx saveToCredential=true, address=10.79.169.37, port=2883),] 2024-12-31 18:29:09.215 INFO 34018 --- [ocp-schedules-29,1007d8499a679874,5e98a9a44c50fb6f] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:29:09.215 INFO 34018 --- [ocp-schedules-29,1007d8499a679874,5e98a9a44c50fb6f] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:29:09.228 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=proxy, clusterName=myoceanbase, obClusterId=null, tenantName=sys, username=root, address=10.79.169.37, port=2883, database=oceanbase) 2024-12-31 18:29:09.228 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] create new ob connector, connectProperties=ConnectProperties(connectionMode=proxy, address=10.79.169.37, port=2883, obsAddrList=null, username=root, tenantName=sys, clusterName=myoceanbase, obClusterId=null, proxy=null, odpSocketConfig=null, vpcId=1, compatibilityMode=MYSQL, database=oceanbase) 2024-12-31 18:29:09.433 INFO 34018 --- [obsdk-init-thread-3,6ee89db68b33ad4f,496274dc77a077f0] com.alibaba.druid.pool.DruidDataSource : {dataSource-5,ob-connector-datasource_proxy_myoceanbase_null_sys_root_10.79.169.37_2883} inited 2024-12-31 18:29:09.433 INFO 34018 --- [obsdk-init-thread-3,6ee89db68b33ad4f,496274dc77a077f0] c.o.o.o.c.impl.AbstractConnector : [obsdk] init druid datasource success, poolingCount=1, connectProperties=ConnectProperties(connectionMode=proxy, address=10.79.169.37, port=2883, obsAddrList=null, username=root, tenantName=sys, clusterName=myoceanbase, obClusterId=null, proxy=null, odpSocketConfig=null, vpcId=1, compatibilityMode=MYSQL, database=oceanbase) 2024-12-31 18:29:09.433 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ObConnectors : [obsdk] create new ob connector success 2024-12-31 18:29:09.436 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.437 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2024-12-31 18:29:09.489 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.493 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2024-12-31 18:29:09.512 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.513 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2024-12-31 18:29:09.539 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.540 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster_id] 2024-12-31 18:29:09.560 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.561 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [obconfig_url] 2024-12-31 18:29:09.568 INFO 34018 --- [prometheus-minute-schedule-1,e716e77c4cbb2951,4164dc59c00b0036] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:09.579 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.580 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2024-12-31 18:29:09.596 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.597 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2024-12-31 18:29:09.611 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.612 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2024-12-31 18:29:09.622 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.623 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [data_dir] 2024-12-31 18:29:09.647 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.648 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2024-12-31 18:29:09.711 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.715 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2024-12-31 18:29:09.743 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2024-12-31 18:29:09.744 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.749 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2024-12-31 18:29:09.851 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.852 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2024-12-31 18:29:09.917 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.918 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2024-12-31 18:29:09.966 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.967 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2024-12-31 18:29:09.986 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:09.987 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2024-12-31 18:29:10.003 INFO 34018 --- [ocp-schedules-10,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:29:10.003 INFO 34018 --- [ocp-schedules-24,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:29:10.028 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:10.029 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2024-12-31 18:29:10.064 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:10.065 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2024-12-31 18:29:10.083 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:10.084 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2024-12-31 18:29:10.122 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:10.123 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2024-12-31 18:29:10.158 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:10.159 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2024-12-31 18:29:10.203 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:10.205 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:10.209 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:10.210 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT COUNT(1) FROM information_schema.TABLES WHERE TABLE_SCHEMA = 'ocp' AND TABLE_NAME = 'ops_config' 2024-12-31 18:29:10.353 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:10.354 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2024-12-31 18:29:10.367 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:10.367 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:29:10.369 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:10.370 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:29:10.371 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:10.371 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [rootservice_list] 2024-12-31 18:29:10.389 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:29:10.390 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [rootservice_list] 2024-12-31 18:29:10.467 ERROR 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.NotFoundException occurred with code error.compute.host.ip.not.found, and args [class com.oceanbase.ocp.core.metadb.repo.compute.host.entity.HostEntity, 10.79.169.37] 2024-12-31 18:29:10.483 ERROR 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.NotFoundException occurred with code error.compute.host.ip.not.found, and args [class com.oceanbase.ocp.core.metadb.repo.compute.host.entity.HostEntity, 10.79.169.36] 2024-12-31 18:29:10.496 ERROR 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.NotFoundException occurred with code error.compute.host.ip.not.found, and args [class com.oceanbase.ocp.core.metadb.repo.compute.host.entity.HostEntity, 10.79.169.38] 2024-12-31 18:29:10.499 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,6ee89db68b33ad4f,756d5947d35ee2af] c.o.o.s.c.trace.RequestTracingAspect : API OK: [POST /api/v2/ob/clusters/takeOverPreCheck client=10.108.139.108, traceId=6ee89db68b33ad4f, duration=1382 ms] 2024-12-31 18:29:10.586 WARN 34018 --- [ocp-async-2,321d38c6369ed593,5679d6e414e30f8c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:10.589 INFO 34018 --- [ocp-async-6,228d303b32c42a88,3ca703b084f409c1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:10.889 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-12-31 18:29:10.908 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-12-31 18:29:11.512 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,89112db0ef758bb2,30f0fd70a38e11fd] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me/credentials?targetType=HOST, client=10.108.139.108, traceId=89112db0ef758bb2, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.CredentialController.listCredentials(AccessTargetType,String,Pageable), args=HOST,Page request [number: 0, size 5000, sort: createTime: DESC],] 2024-12-31 18:29:11.524 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,026947d33a4ac3d4,9d102fe0524a5dd7] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/hostTypes?null, client=10.108.139.108, traceId=026947d33a4ac3d4, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listHostTypes(Pageable), args=Page request [number: 0, size 5000, sort: id: DESC],] 2024-12-31 18:29:11.556 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,026947d33a4ac3d4,9d102fe0524a5dd7] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hostTypes client=10.108.139.108, traceId=026947d33a4ac3d4, duration=39 ms] 2024-12-31 18:29:11.641 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,89112db0ef758bb2,30f0fd70a38e11fd] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me/credentials client=10.108.139.108, traceId=89112db0ef758bb2, duration=141 ms] 2024-12-31 18:29:11.657 INFO 34018 --- [ocp-schedules-11,bfb2bc35be28fc98,4cb30ddf03d3c2ac] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:29:12.568 INFO 34018 --- [prometheus-minute-schedule-1,7159ee08b651e6f8,d7bf61b64e417d97] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:12.569 INFO 34018 --- [prometheus-hour-schedule-1,0d4074f477735c25,ae8bea59a86cf6eb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:29:12.586 WARN 34018 --- [ocp-async-10,60ea6517d5e6755e,8197ad01dc53039f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:12.589 INFO 34018 --- [ocp-async-5,0cdf00029d98a455,2e8ea4b1f9cd7166] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:12.722 INFO 34018 --- [metric-archive-second-8,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640880, nodeCount=357, affectRows=357 2024-12-31 18:29:12.724 INFO 34018 --- [metric-archive-second-8,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640880, nodeCount=356, validCount=356 2024-12-31 18:29:13.205 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:13.208 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:14.586 WARN 34018 --- [ocp-async-1,09f30eb1e60047d9,612a99c56907e5df] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:14.590 INFO 34018 --- [ocp-async-8,9a4da6252cab24d3,099ad613a25e0e3f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:15.568 INFO 34018 --- [prometheus-minute-schedule-1,2476ea65240b6a90,28d17c879975b071] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:16.208 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:16.210 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:16.586 WARN 34018 --- [ocp-async-8,a265b37ae6762dcb,9bd541165fabc9b9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:16.590 INFO 34018 --- [ocp-async-9,5fd25f4883488173,35c9281a84c3f497] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:18.457 INFO 34018 --- [ocp-schedules-19,f0e966c896e3a864,65557d77964f9e0e] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:29:18.458 INFO 34018 --- [ocp-schedules-1,0125d21f3828c202,bda8ede57edab4f2] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:29:18.458 INFO 34018 --- [ocp-schedules-4,f971404ca53e4688,866ac0383081580f] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:29:18.458 INFO 34018 --- [ocp-schedules-20,6c98a8bd19fa8b6f,2daff0bb39390057] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:29:18.464 INFO 34018 --- [ocp-schedules-27,f8bf4b3657b7fce4,c23a8cf4379895cf] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:29:18.473 INFO 34018 --- [ocp-schedules-22,624ef81a8b9e7750,ad535551a84e2046] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:29:18.473 INFO 34018 --- [ocp-schedules-11,ed1bd4a0d52d9dcd,2e0f55f90ff5b24b] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:29:18.473 INFO 34018 --- [ocp-schedules-11,ed1bd4a0d52d9dcd,2e0f55f90ff5b24b] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:29:18.474 INFO 34018 --- [ocp-schedules-14,099ae870075b2ab3,ec813bda0088d002] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:29:18.474 INFO 34018 --- [ocp-schedules-14,099ae870075b2ab3,ec813bda0088d002] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:29:18.475 INFO 34018 --- [ocp-schedules-22,624ef81a8b9e7750,ad535551a84e2046] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:29:18.498 INFO 34018 --- [ocp-async-9,688067f0b0f49fdf,d8aaa7d96373c5a8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:29:18.523 INFO 34018 --- [ocp-schedules-2,1e08dd5df3e3013a,544e5f0474dfbbd2] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:29:18.568 INFO 34018 --- [prometheus-minute-schedule-1,e2dcbdbaadf93258,ca7696954cfb8664] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:18.570 INFO 34018 --- [ocp-schedules-23,21bff94530673983,7507fe0daca82005] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:29:18.587 WARN 34018 --- [ocp-async-10,bcc57fbe315d0739,1bf1f945d0920669] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:18.590 INFO 34018 --- [ocp-async-4,17636ff303e190e8,ac902490f6e97260] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:18.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:29:18.589371+08:00, lastProcessTime=2024-12-31T18:29:08.589606+08:00 2024-12-31 18:29:18.759 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:29:18.589371+08:00 2024-12-31 18:29:19.210 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:19.212 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:20.587 WARN 34018 --- [ocp-async-4,44af9a470bddbaf9,e82f6d6378576390] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:20.590 INFO 34018 --- [ocp-async-3,c7348c4def3fca7a,c270c1ed69727758] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:21.568 INFO 34018 --- [prometheus-minute-schedule-1,ef79f0a79fb00ea2,eb431223bfeca792] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:21.700 INFO 34018 --- [ocp-schedules-25,837025bdffb7704c,cae5f9ac2b95656e] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:29:22.212 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:22.214 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:22.587 WARN 34018 --- [ocp-async-2,bce2479fcc40baae,4ec9518c0a008d93] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:22.590 INFO 34018 --- [ocp-async-7,3c691fc449e86b7f,81d6bea2023b68db] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:24.568 INFO 34018 --- [prometheus-minute-schedule-1,abf281cce14c0d9e,82d4f9ea0d1abe93] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:24.587 WARN 34018 --- [ocp-async-7,6619b84889649aad,e434929738d50ab3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:24.590 INFO 34018 --- [ocp-async-5,bd2715f7691fedc6,4e369abd79d9339c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:25.214 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:25.216 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:26.587 WARN 34018 --- [ocp-async-5,a2ee3719fd83f150,19e43dee75ebb67d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:26.591 INFO 34018 --- [ocp-async-1,5a86acd651f29fc6,53876795d4277580] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:27.568 INFO 34018 --- [prometheus-minute-schedule-1,6b245c62c44c4f4b,31e20c092d5f481f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:28.216 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:28.218 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:28.498 INFO 34018 --- [ocp-async-1,c5b7740795c4f421,a9509b03ad586b18] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:29:28.523 INFO 34018 --- [ocp-schedules-28,386a2c169ccd6809,c9e5e8c952ca73ed] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:29:28.587 WARN 34018 --- [ocp-async-2,2abf92802509a8d6,2b9ac8d456fd9b8d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:28.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:29:28.588531+08:00, lastProcessTime=2024-12-31T18:29:18.589371+08:00 2024-12-31 18:29:28.591 INFO 34018 --- [ocp-async-10,de866e890b08664c,16a8579f660f978e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:28.753 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:29:28.588531+08:00 2024-12-31 18:29:29.219 INFO 34018 --- [ocp-schedules-23,798647ba977df422,a0e1a7f8d4e3cc7b] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:29:29.230 INFO 34018 --- [ocp-schedules-23,798647ba977df422,a0e1a7f8d4e3cc7b] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:29:29.230 INFO 34018 --- [ocp-schedules-23,798647ba977df422,a0e1a7f8d4e3cc7b] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:29:30.568 INFO 34018 --- [prometheus-minute-schedule-1,25da4f1d3b106af4,77e86e56ad61e642] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:30.588 WARN 34018 --- [ocp-async-7,da3e7b4c052521ed,2c4ac37e6de169d5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:30.591 INFO 34018 --- [ocp-async-6,71d07a5c3757ebae,930cf8929912c195] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:31.218 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:31.221 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:31.744 INFO 34018 --- [ocp-schedules-25,14ccc8f72d40955e,9b6bb815956399da] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:29:32.588 WARN 34018 --- [ocp-async-4,75968ebc8178a5a8,20c9526726124a62] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:32.591 INFO 34018 --- [ocp-async-8,967995ae3c29f873,845cb4c970d90a39] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:33.568 INFO 34018 --- [prometheus-minute-schedule-1,c62f51c6618ef82a,15e6c1a38c84f364] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:34.221 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:34.223 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:34.588 WARN 34018 --- [ocp-async-2,c34d592e09673803,8b1694536d4801ab] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:34.591 INFO 34018 --- [ocp-async-9,9063859fff132a45,6e24807880ce1501] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:36.568 INFO 34018 --- [prometheus-minute-schedule-1,ab325d7d8d2dc3dc,de7c5b0c9457b9e1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:36.569 INFO 34018 --- [prometheus-cache-monitor1,f558c2e086af4f42,e520626e503034b3] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1404,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":363,"seriesIdKeySize":363,"secondWriteQueue":0,"minuteWriteCacheSize":356} 2024-12-31 18:29:36.570 INFO 34018 --- [prometheus-cache-monitor1,f558c2e086af4f42,e520626e503034b3] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=40, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=40, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:29:36.588 WARN 34018 --- [ocp-async-7,3e95dd03ac3c16de,5f746b2564cfcd46] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:36.591 INFO 34018 --- [ocp-async-3,e5164468a9a338b0,b99c5c4865950b75] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:37.223 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:37.225 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:38.502 INFO 34018 --- [ocp-async-3,88b68080ea0d4e77,65de8dd50d6aaa79] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:29:38.523 INFO 34018 --- [ocp-schedules-5,0bac0b7991c9ebc5,7fd454918e5533f0] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:29:38.588 WARN 34018 --- [ocp-async-4,c54b6025f01723b8,db4b19ac62bd9e4e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:38.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:29:38.589003+08:00, lastProcessTime=2024-12-31T18:29:28.588531+08:00 2024-12-31 18:29:38.591 INFO 34018 --- [ocp-async-8,76ec458c9c213c41,bd9a1ddd2b905e74] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:38.753 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:29:38.589003+08:00 2024-12-31 18:29:39.568 INFO 34018 --- [prometheus-minute-schedule-1,13c7a926b57863db,6600539889d06151] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:40.004 INFO 34018 --- [ocp-schedules-29,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:29:40.004 INFO 34018 --- [ocp-schedules-15,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:29:40.225 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:40.227 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:40.589 WARN 34018 --- [ocp-async-2,a642ed10701be256,41e28d0872583ca3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:40.592 INFO 34018 --- [ocp-async-10,7f4e84acdc9e40b7,d9b6e4f31df6af0d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:41.784 INFO 34018 --- [ocp-schedules-29,c44beb59a2e27b30,d4188a8af87c4f93] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:29:42.568 INFO 34018 --- [prometheus-minute-schedule-1,1ba5ef2237175be2,d7880418ac57d207] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:42.589 WARN 34018 --- [ocp-async-7,d0f037b0a074a05d,09b12848f59ac73f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:42.592 INFO 34018 --- [ocp-async-3,1bd29e6cc3c00304,4e6d3536835631ad] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:43.228 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:43.230 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:44.589 WARN 34018 --- [ocp-async-4,976f55782be3f0b3,5306fcd62795acc3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:44.592 INFO 34018 --- [ocp-async-5,02ed30aac0cbfdef,ee8a6fe943ae5c23] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:45.568 INFO 34018 --- [prometheus-minute-schedule-1,ccee9fd39d2e1c66,130f3a78b382a7b9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:46.230 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:46.232 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:46.589 WARN 34018 --- [ocp-async-8,46cbcf6239cc4486,29eeabadd157593f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:46.592 INFO 34018 --- [ocp-async-1,5167c8770da3c522,c49c566724da2cb6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:48.456 INFO 34018 --- [ocp-schedules-3,995e317d5cf1f392,510824da5bb88635] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:29:48.457 INFO 34018 --- [ocp-schedules-5,0fe21ac2874c94c0,306575dbbb5dc912] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:29:48.458 INFO 34018 --- [ocp-schedules-6,b7bc18d7c2f1e99b,8055cdccbc18cbc8] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:29:48.458 INFO 34018 --- [ocp-schedules-27,4aafe5aee11176d6,4ae88c7ca8bae0e2] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:29:48.458 INFO 34018 --- [ocp-schedules-14,0dfb481754f821cb,553dccb691c9dd7d] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:29:48.458 INFO 34018 --- [ocp-schedules-28,0cd0db6e21a32cec,251d0478bdd55041] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:29:48.465 INFO 34018 --- [ocp-schedules-3,995e317d5cf1f392,510824da5bb88635] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:29:48.466 INFO 34018 --- [ocp-schedules-2,72586556dd57af9d,ef16a02e39dfbe12] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:29:48.466 INFO 34018 --- [ocp-schedules-14,0dfb481754f821cb,553dccb691c9dd7d] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:29:48.467 INFO 34018 --- [ocp-schedules-18,6ac28dd11ee4858a,8c02322cb9bb6407] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster root server. 2024-12-31 18:29:48.469 INFO 34018 --- [ocp-schedules-26,315a1cc66f7c3dbe,ea07197972b8cb5d] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:29:48.469 INFO 34018 --- [ocp-schedules-26,315a1cc66f7c3dbe,ea07197972b8cb5d] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:29:48.469 INFO 34018 --- [ocp-schedules-21,f7040bfb0967fdf4,a92a52d0ad4c10c0] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:29:48.469 INFO 34018 --- [ocp-schedules-21,f7040bfb0967fdf4,a92a52d0ad4c10c0] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:29:48.470 INFO 34018 --- [ocp-schedules-29,36b33688a073f389,839c884883f69f50] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:29:48.470 INFO 34018 --- [ocp-schedules-29,36b33688a073f389,839c884883f69f50] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:29:48.481 INFO 34018 --- [ocp-schedules-10,04badd1c1ebae908,e2380bbe75d8b13d] c.o.o.s.common.scheduled.OcpSchedules : Cleanup ocp connection pools. 2024-12-31 18:29:48.482 INFO 34018 --- [ocp-schedules-10,04badd1c1ebae908,e2380bbe75d8b13d] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2024-12-31 18:29:48.499 INFO 34018 --- [ocp-schedules-15,33b33b59c88b55f6,aa7482e11709d84a] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster system event. 2024-12-31 18:29:48.502 INFO 34018 --- [ocp-async-7,8bd3cd0d52f2c555,561cba6c98b109b3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:29:48.516 INFO 34018 --- [ocp-schedules-1,e251de35735cf194,6943710e62b49489] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1404,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":363,"seriesIdKeySize":363,"secondWriteQueue":0,"minuteWriteCacheSize":356} 2024-12-31 18:29:48.516 INFO 34018 --- [ocp-schedules-1,e251de35735cf194,6943710e62b49489] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=40, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=40, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:29:48.521 INFO 34018 --- [ocp-schedules-22,c5d5158e323ceabf,2455fbce5502d6f5] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant mini compaction 2024-12-31 18:29:48.521 INFO 34018 --- [ocp-schedules-22,c5d5158e323ceabf,2455fbce5502d6f5] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2024-12-31 18:29:48.522 INFO 34018 --- [ocp-schedules-9,57c20f696a178d3a,56327bd66f987763] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2024-12-31 18:29:48.523 INFO 34018 --- [ocp-schedules-5,f821179dbd25d4ca,0f2ab56a27eeff4c] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:29:48.523 INFO 34018 --- [ocp-schedules-22,c5d5158e323ceabf,2455fbce5502d6f5] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2024-12-31 18:29:48.526 INFO 34018 --- [ocp-schedules-27,f684d8a78ae2ca7c,417a9f6a2faa66c2] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper 2024-12-31 18:29:48.527 INFO 34018 --- [ocp-schedules-12,790602e5fb286174,0beea75a683a3f20] c.o.o.m.service.SeriesIdCleanService : Clean series by list started. 2024-12-31 18:29:48.527 INFO 34018 --- [ocp-schedules-12,790602e5fb286174,0beea75a683a3f20] c.o.o.m.service.SeriesIdCleanService : Clean series by list finished. 2024-12-31 18:29:48.527 INFO 34018 --- [ocp-schedules-12,790602e5fb286174,0beea75a683a3f20] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache started, seriesIdKeySize=363 2024-12-31 18:29:48.547 INFO 34018 --- [ocp-schedules-6,4d21cb39832380f4,7794bc89d7f882aa] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:29:48.547+08:00, clusters=[] 2024-12-31 18:29:48.547 INFO 34018 --- [ocp-schedules-26,9a4faa83672220ab,d2881c53045a2598] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:29:48.559 INFO 34018 --- [ocp-schedules-26,0ca4e536ee0c4bc8,4da82110f8abc846] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:29:48.559 INFO 34018 --- [ocp-schedules-21,1f2d49e86895a735,8cb191150c0ee708] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:29:48.559 INFO 34018 --- [ocp-schedules-21,1f2d49e86895a735,8cb191150c0ee708] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:29:48.559 INFO 34018 --- [ocp-schedules-4,f24c5a948d161bbb,ae0ffe0606521b34] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:29:48.559 INFO 34018 --- [ocp-schedules-4,f24c5a948d161bbb,ae0ffe0606521b34] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:29:48.560 INFO 34018 --- [ocp-schedules-14,fd06744cf476b7f1,ef811ddd9f1a43e3] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:29:48.561 INFO 34018 --- [ocp-schedules-2,f3fd442c87141a96,c521f3a4ae47893b] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:29:48.561+08:00, clusters=[] 2024-12-31 18:29:48.562 INFO 34018 --- [ocp-schedules-21,1f2d49e86895a735,8cb191150c0ee708] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:29:48.562 INFO 34018 --- [ocp-schedules-21,1f2d49e86895a735,8cb191150c0ee708] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:29:48.563 INFO 34018 --- [ocp-schedules-3,b07982af8ceecbd5,20e122380c96ecd9] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:29:48.567 INFO 34018 --- [ocp-schedules-29,3f8f1d1837fafdda,770e3a7f9f7d32b5] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[] 2024-12-31 18:29:48.567 INFO 34018 --- [ocp-schedules-29,3f8f1d1837fafdda,770e3a7f9f7d32b5] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2024-12-31 18:29:48.568 INFO 34018 --- [prometheus-minute-schedule-1,e17ea2a3c2661a92,31d3c1d234bae432] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:48.572 INFO 34018 --- [ocp-schedules-10,b3c2d5fa8486efb4,114a3631d2eca458] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:29:48.584 INFO 34018 --- [ocp-schedules-12,790602e5fb286174,0beea75a683a3f20] c.o.o.m.service.SeriesIdCleanService : Clean series info in cache ended, seriesIdKeySize=363 2024-12-31 18:29:48.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:29:48.588148+08:00, lastProcessTime=2024-12-31T18:29:38.589003+08:00 2024-12-31 18:29:48.589 WARN 34018 --- [ocp-async-4,96e19e59667779db,c6fb9c67e579e0d8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:48.591 INFO 34018 --- [ocp-schedules-7,ef181b3ce35fbe9c,75c36f47a2632b76] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:29:48.592 INFO 34018 --- [ocp-async-6,9580e1b5ab5b5935,0776c3a564687529] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:48.594 INFO 34018 --- [ocp-schedules-7,ef181b3ce35fbe9c,75c36f47a2632b76] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:29:48.594 INFO 34018 --- [ocp-schedules-7,ef181b3ce35fbe9c,75c36f47a2632b76] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 0 2024-12-31 18:29:48.615 INFO 34018 --- [ocp-schedules-25,01cf81c48df2dc7f,e2714f56597679d3] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2024-12-31 18:29:48.616 INFO 34018 --- [ocp-schedules-25,01cf81c48df2dc7f,e2714f56597679d3] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2024-12-31 18:29:48.662 INFO 34018 --- [ocp-schedules-20,4093f6a1973709e4,c0f30bbed85d8c83] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:29:48.662 INFO 34018 --- [ocp-schedules-20,4093f6a1973709e4,c0f30bbed85d8c83] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:29:48.669 INFO 34018 --- [ocp-schedules-20,4093f6a1973709e4,c0f30bbed85d8c83] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:29:48.669 INFO 34018 --- [ocp-schedules-20,4093f6a1973709e4,c0f30bbed85d8c83] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:29:48.676 INFO 34018 --- [ocp-schedules-20,4093f6a1973709e4,c0f30bbed85d8c83] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:29:48.676 INFO 34018 --- [ocp-schedules-20,4093f6a1973709e4,c0f30bbed85d8c83] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730653623019405312 2024-12-31 18:29:48.677 INFO 34018 --- [ocp-schedules-20,4093f6a1973709e4,c0f30bbed85d8c83] c.o.ocp.monitor.service.IdKeyService : Sync record key and id, newRecordIdsCount=6, maxSyncedRecordId=730653811830194176 2024-12-31 18:29:48.737 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:29:48.588148+08:00 2024-12-31 18:29:49.232 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:49.233 INFO 34018 --- [ocp-schedules-5,0a5fcf52ec13aff3,256b657965606e92] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:29:49.234 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:49.244 INFO 34018 --- [ocp-schedules-5,0a5fcf52ec13aff3,256b657965606e92] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:29:49.244 INFO 34018 --- [ocp-schedules-5,0a5fcf52ec13aff3,256b657965606e92] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:29:50.589 WARN 34018 --- [ocp-async-8,9ff34620edd71667,399ac6b8a9715c24] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:50.593 INFO 34018 --- [ocp-async-2,9b806812bc32bb09,e8dab9831995eaf8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:51.568 INFO 34018 --- [prometheus-minute-schedule-1,81453a22cebdc84e,036a867aa51423e4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:51.824 INFO 34018 --- [ocp-schedules-23,6cae59b9c4976ed0,10fa7637161a8595] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:29:51.889 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:29:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:29:52.234 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:52.236 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:52.590 WARN 34018 --- [ocp-async-10,1ae744da4be746a8,54b85a04c42b837d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:52.593 INFO 34018 --- [ocp-async-7,8980b1ef35eb0c44,f59f712be082492d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:54.568 INFO 34018 --- [prometheus-minute-schedule-1,78be1172ca46e065,0c0976fb0ac6ebdb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:54.590 WARN 34018 --- [ocp-async-4,a0aa37bf48219296,87bb2c93fe448429] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:54.593 INFO 34018 --- [ocp-async-3,a948c681e2aa9e6b,5fa7db0d6be17245] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:55.236 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:55.238 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:56.590 WARN 34018 --- [ocp-async-8,53ded1a2eb2ff7f0,5202906534dce904] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:56.593 INFO 34018 --- [ocp-async-5,8713aeed123e795e,01beaa4177f6164d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:57.568 INFO 34018 --- [prometheus-minute-schedule-1,86c0a0f458f01ae3,0a74d648ece22d32] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641000, interval=60 2024-12-31 18:29:58.239 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:29:58.241 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:29:58.502 INFO 34018 --- [ocp-async-2,14c9d87b1d5efec4,48324235dfd0a728] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:29:58.523 INFO 34018 --- [ocp-schedules-4,165ac5a69fbeddc7,c8b7ceafadbaf728] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:29:58.590 WARN 34018 --- [ocp-async-1,82f19cc6b1885e51,66bbdac4c7e06f77] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:29:58.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:29:58.589888+08:00, lastProcessTime=2024-12-31T18:29:48.588148+08:00 2024-12-31 18:29:58.593 INFO 34018 --- [ocp-async-4,2e0ac7a8b4e45a76,c169181de9a635d5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:29:58.761 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:29:58.589888+08:00 2024-12-31 18:30:00.314 INFO 34018 --- [task-coordinator1,93cfe403787200b1,0ad30adce661e2b7] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-12-31 18:25:01.0, nextRun=2024-12-31 18:30:00.0, currentDate=Tue Dec 31 18:30:00 CST 2024 2024-12-31 18:30:00.314 INFO 34018 --- [task-coordinator1,93cfe403787200b1,0ad30adce661e2b7] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999985, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2024-12-31 18:25:01.0, nextRunTime=2024-12-31 18:30:00.0} 2024-12-31 18:30:00.320 INFO 34018 --- [task-coordinator1,93cfe403787200b1,0ad30adce661e2b7] c.o.o.p.s.internal.SqlParseTaskSchedule : get Clusters for parse:[] 2024-12-31 18:30:00.372 INFO 34018 --- [task-coordinator1,93cfe403787200b1,0ad30adce661e2b7] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2024-12-31 18:30:00.372 INFO 34018 --- [task-coordinator1,93cfe403787200b1,0ad30adce661e2b7] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2024-12-31 18:30:00.568 INFO 34018 --- [prometheus-minute-schedule-1,b8d224bf9588d011,9a1da5f13a41efa1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:00.590 WARN 34018 --- [ocp-async-9,8ebd4ca940a10fe4,835e3b305247de89] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:00.593 INFO 34018 --- [ocp-async-8,1e6ec5df17bbe71f,5d3bf06d7342522e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:01.241 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:01.243 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:01.868 INFO 34018 --- [ocp-schedules-7,5bac55be74087f8b,a61c281ef8d30391] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:30:02.590 WARN 34018 --- [ocp-async-5,de30fbbaaed28745,f081adcb49943ac0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:02.594 INFO 34018 --- [ocp-async-2,e054d9dd5ad6a100,7f414d762ee0f572] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:03.568 INFO 34018 --- [prometheus-minute-schedule-1,4d0ddd6c9925a239,7ab3e2ba241b3dbd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:04.163 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:04.164 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:30:04.166 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:04.166 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:30:04.167 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2024-12-31 18:30:04.171 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=4ms, period=120000ms 2024-12-31 18:30:04.243 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:04.246 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:04.470 INFO 34018 --- [task-coordinator1,93cfe403787200b1,8358b42f2c93a284] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-12-31 18:20:04.0, nextRun=2024-12-31 18:30:04.0, currentDate=Tue Dec 31 18:30:04 CST 2024 2024-12-31 18:30:04.470 INFO 34018 --- [task-coordinator1,93cfe403787200b1,8358b42f2c93a284] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999999, name=Partitioning daemon, templateName=PartitioningDaemonSchedule, scheduleRule=4 */10 * * * *, lastRunTime=2024-12-31 18:20:04.0, nextRunTime=2024-12-31 18:30:04.0} 2024-12-31 18:30:04.478 INFO 34018 --- [task-coordinator1,93cfe403787200b1,8358b42f2c93a284] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Partition rollover daemon, nodeCount=1, taskCount=1 2024-12-31 18:30:04.478 INFO 34018 --- [task-coordinator1,93cfe403787200b1,8358b42f2c93a284] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Partition rollover daemon', taskDefinitionId=999999, state=RUNNING, type=SYS_SCHEDULED, clusterId=null, tenantId=null, hostId=null, creator='system', executor='10.79.169.37', argument=Argument{parallelIdx=-1, stringMap={prohibit_rollback=false}, listMap={}}, createTime=null, startTime=2024-12-31T18:30:04.478+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Partition rollover daemon, state=READY, operation=EXECUTE, className=com.oceanbase.ocp.service.partitioning.PartitioningDaemonSchedule$Task, seriesId=0, startTime=null, endTime=null}], template=null, traceId='93cfe403787200b1', operation=EXECUTE} 2024-12-31 18:30:04.591 WARN 34018 --- [ocp-async-10,a4965ad2f7f0b5c1,6661d2fe44702318] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:04.594 INFO 34018 --- [ocp-async-1,c5176a88a7862a2d,af3bd57853106de8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:05.390 INFO 34018 --- [subtask-coordinator2,93cfe403787200b1,1bb390954b25f1a3] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 2, operation:EXECUTE, state: RUNNING 2024-12-31 18:30:05.408 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=2, context=Context{parallelIdx=-1, stringMap={task_instance_id=2, task_operation=execute, latest_execution_start_time=2024-12-31T18:30:05.381+08:00, sub_task_instance_name=Partition rollover daemon, sub_task_instance_id=2}, listMap={}}, executor=10.79.169.37 2024-12-31 18:30:05.417 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key part-worker 2024-12-31 18:30:05.417 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Monitordb 2024-12-31 18:30:05.418 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.419 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:30:05.420 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.420 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.421 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.421 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_0 2024-12-31 18:30:05.467 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.468 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.468 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.469 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_1 2024-12-31 18:30:05.497 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.498 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.498 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.499 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_2 2024-12-31 18:30:05.535 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.535 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.536 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.536 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat 2024-12-31 18:30:05.562 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.562 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.563 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.564 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sqltext 2024-12-31 18:30:05.608 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.608 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.609 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.609 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_dynamic_sql 2024-12-31 18:30:05.620 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.621 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.621 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.621 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_high_risk_sql 2024-12-31 18:30:05.633 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.634 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.634 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.635 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_stat_0 2024-12-31 18:30:05.664 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.664 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.664 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.665 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan 2024-12-31 18:30:05.690 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.690 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.690 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.691 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_explain 2024-12-31 18:30:05.713 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.713 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.713 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.714 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample 2024-12-31 18:30:05.744 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.745 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.745 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.746 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample_statistics 2024-12-31 18:30:05.777 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.778 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.778 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.779 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis_task 2024-12-31 18:30:05.784 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.784 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.785 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.785 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis 2024-12-31 18:30:05.805 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.805 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.806 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.806 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_active_session_stat_0 2024-12-31 18:30:05.819 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.819 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.820 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.820 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_snapshot 2024-12-31 18:30:05.831 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.832 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.832 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.833 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cluster 2024-12-31 18:30:05.843 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.843 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.844 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.844 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_tenant 2024-12-31 18:30:05.854 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.854 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.855 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.855 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_server 2024-12-31 18:30:05.866 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.866 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.866 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.867 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_replica 2024-12-31 18:30:05.876 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.876 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.877 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.877 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sysstat 2024-12-31 18:30:05.887 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.887 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.888 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.888 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_row_lock 2024-12-31 18:30:05.898 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.899 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.899 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.899 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_latch 2024-12-31 18:30:05.909 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.910 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.910 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.910 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cache 2024-12-31 18:30:05.920 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.920 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.921 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.921 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_parameter 2024-12-31 18:30:05.930 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.930 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.931 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.931 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_rpc 2024-12-31 18:30:05.942 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.942 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.943 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.943 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_packet 2024-12-31 18:30:05.954 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.954 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.955 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.955 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_clog 2024-12-31 18:30:05.965 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.966 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.966 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.967 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_location_cache 2024-12-31 18:30:05.977 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.978 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.978 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.978 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_gts 2024-12-31 18:30:05.988 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.989 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:05.989 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:05.989 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_system_event 2024-12-31 18:30:05.999 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.000 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.000 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.001 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_memory 2024-12-31 18:30:06.011 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.011 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.011 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.012 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_hit 2024-12-31 18:30:06.021 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.022 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.022 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.022 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_plan_monitor 2024-12-31 18:30:06.042 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.042 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.043 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.043 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_trans_stat_v2 2024-12-31 18:30:06.061 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.061 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.062 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.062 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_system_event 2024-12-31 18:30:06.079 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.080 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.080 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.081 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_server_event 2024-12-31 18:30:06.098 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.099 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.099 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.099 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_1 2024-12-31 18:30:06.109 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.109 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.109 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.110 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_60 2024-12-31 18:30:06.119 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.119 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.120 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.120 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_hour_data 2024-12-31 18:30:06.129 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.130 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.130 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.130 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_daily_data 2024-12-31 18:30:06.141 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.141 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.141 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.142 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_second 2024-12-31 18:30:06.155 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.155 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.156 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.156 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_minute 2024-12-31 18:30:06.195 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.195 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.196 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.196 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_hour 2024-12-31 18:30:06.211 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.211 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.212 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.212 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_daily 2024-12-31 18:30:06.226 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.226 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.227 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.227 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_async 2024-12-31 18:30:06.240 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.241 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.241 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.241 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table sql_aggregate_data 2024-12-31 18:30:06.251 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.251 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.252 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.252 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_stats_compressed 2024-12-31 18:30:06.261 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.262 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.262 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.262 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_tenant_mini_compaction_info 2024-12-31 18:30:06.284 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Monitordb 2024-12-31 18:30:06.284 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Metadb 2024-12-31 18:30:06.285 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.285 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:30:06.287 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.287 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.288 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.288 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table profile_credential_sharing 2024-12-31 18:30:06.313 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.313 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:30:06.314 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:06.314 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_cache_info 2024-12-31 18:30:06.326 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Metadb 2024-12-31 18:30:06.340 INFO 34018 --- [subtask-executor2,93cfe403787200b1,de42a7a925b7cbb2] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 2, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:30:06.388 INFO 34018 --- [task-coordinator3,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:2, status:SUCCESS 2024-12-31 18:30:06.390 INFO 34018 --- [task-coordinator3,,] c.o.ocp.service.audit.AuditEventService : audit event not found, taskId:2, status:SUCCESS 2024-12-31 18:30:06.568 INFO 34018 --- [prometheus-minute-schedule-1,93ebec2e2dad1231,7f83cc4b282b17ca] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:06.591 WARN 34018 --- [ocp-async-1,1a73b7b5f6549c2b,b152a82528d4f362] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:06.594 INFO 34018 --- [ocp-async-9,01ec87085a7184ac,234092f039c1336b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:07.246 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:07.248 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:08.502 INFO 34018 --- [ocp-async-3,745a032a14782373,0d9057b39102cfdc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:30:08.524 INFO 34018 --- [ocp-schedules-4,38d262a85fa35eff,e7050753bfd6575d] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:30:08.588 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:30:08.587111+08:00, lastProcessTime=2024-12-31T18:29:58.589888+08:00 2024-12-31 18:30:08.591 WARN 34018 --- [ocp-async-6,01bbb9e506f4e4db,ffad71267b04b934] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:08.594 INFO 34018 --- [ocp-async-8,2a4edc978075e48f,0c2c41ac24604c27] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:08.728 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:30:08.587111+08:00 2024-12-31 18:30:09.247 INFO 34018 --- [ocp-schedules-12,3b7c20d64d4be40f,a42b1f6f4dd33b62] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:30:09.258 INFO 34018 --- [ocp-schedules-12,3b7c20d64d4be40f,a42b1f6f4dd33b62] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:30:09.258 INFO 34018 --- [ocp-schedules-12,3b7c20d64d4be40f,a42b1f6f4dd33b62] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:30:09.568 INFO 34018 --- [prometheus-minute-schedule-1,1857ac8cf9ee698c,f3ccb8386ddd1626] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:10.003 INFO 34018 --- [ocp-schedules-6,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:30:10.004 INFO 34018 --- [ocp-schedules-4,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:30:10.248 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:10.250 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:10.591 WARN 34018 --- [ocp-async-8,df39decede057daa,3477ca858c4b4e74] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:10.594 INFO 34018 --- [ocp-async-2,42c038cb47fa096d,c2348e96622c7b2b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:10.801 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,f3a65749196dea2f,94ab7ac77fea88a6] c.o.o.s.c.c.s.utils.CsrfRequestMatcher : CSRF token required for API [POST /api/v2/compute/hostTypes, client 10.108.139.108, traceId f3a65749196dea2f] 2024-12-31 18:30:10.813 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,f3a65749196dea2f,94ab7ac77fea88a6] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /api/v2/compute/hostTypes?null, client=10.108.139.108, traceId=f3a65749196dea2f, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ComputeController.createHostType(CreateHostTypeRequest), args=CreateHostTypeRequest(name=ip169xx, description=null),] 2024-12-31 18:30:10.846 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,f3a65749196dea2f,94ab7ac77fea88a6] c.o.o.c.h.service.HostTypeServiceImpl : Created hostType: 1 ip169xx 2024-12-31 18:30:10.847 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,f3a65749196dea2f,94ab7ac77fea88a6] c.o.o.s.c.trace.RequestTracingAspect : API OK: [POST /api/v2/compute/hostTypes client=10.108.139.108, traceId=f3a65749196dea2f, duration=53 ms] 2024-12-31 18:30:10.889 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 0, ruleSize = 0. 2024-12-31 18:30:10.908 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 0, ruleSize = 0. 2024-12-31 18:30:11.076 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,855417a5f83c7b3e,2d1b0f6a31b529c2] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/hostTypes?null, client=10.108.139.108, traceId=855417a5f83c7b3e, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listHostTypes(Pageable), args=Page request [number: 0, size 5000, sort: id: DESC],] 2024-12-31 18:30:11.080 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,855417a5f83c7b3e,2d1b0f6a31b529c2] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hostTypes client=10.108.139.108, traceId=855417a5f83c7b3e, duration=11 ms] 2024-12-31 18:30:11.930 INFO 34018 --- [ocp-schedules-14,27daac1c58f37c38,11fa3d65acdf060e] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:30:12.568 INFO 34018 --- [prometheus-minute-schedule-1,f616dff262279816,745a8b3b7faee960] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:12.569 INFO 34018 --- [prometheus-hour-schedule-1,e239b60333266490,475877b12766578e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:30:12.591 WARN 34018 --- [ocp-async-4,42ec089ec0d3813c,b45a264d66493e9b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:12.594 INFO 34018 --- [ocp-async-9,91dcf249580bf1b5,685452ccf265fb82] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:12.670 INFO 34018 --- [metric-archive-second-36,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640940, nodeCount=7, affectRows=7 2024-12-31 18:30:12.670 INFO 34018 --- [metric-archive-second-37,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640940, nodeCount=6, affectRows=6 2024-12-31 18:30:12.670 INFO 34018 --- [metric-archive-second-37,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640940, nodeCount=6, validCount=6 2024-12-31 18:30:12.670 INFO 34018 --- [metric-archive-second-36,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640940, nodeCount=7, validCount=7 2024-12-31 18:30:12.671 INFO 34018 --- [metric-archive-second-13,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640940, nodeCount=38, affectRows=38 2024-12-31 18:30:12.671 INFO 34018 --- [metric-archive-second-11,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640940, nodeCount=21, affectRows=21 2024-12-31 18:30:12.671 INFO 34018 --- [metric-archive-second-11,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640940, nodeCount=21, validCount=21 2024-12-31 18:30:12.672 INFO 34018 --- [metric-archive-second-13,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640940, nodeCount=38, validCount=38 2024-12-31 18:30:12.674 INFO 34018 --- [metric-archive-second-17,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640940, nodeCount=147, affectRows=147 2024-12-31 18:30:12.674 INFO 34018 --- [metric-archive-second-17,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640940, nodeCount=147, validCount=147 2024-12-31 18:30:12.676 INFO 34018 --- [metric-archive-second-14,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735640940, nodeCount=144, affectRows=144 2024-12-31 18:30:12.676 INFO 34018 --- [metric-archive-second-14,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735640940, nodeCount=143, validCount=143 2024-12-31 18:30:13.250 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:13.252 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:14.591 WARN 34018 --- [ocp-async-3,54a40463bfac9310,52b0635b3b695b19] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:14.594 INFO 34018 --- [ocp-async-5,ba103df18437d2ae,259ca7f9468c58d1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:15.503 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,8fec421e63032d46,df8c0654806a5b6c] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me/credentials?targetType=HOST, client=10.108.139.108, traceId=8fec421e63032d46, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.CredentialController.listCredentials(AccessTargetType,String,Pageable), args=HOST,Page request [number: 0, size 5000, sort: createTime: DESC],] 2024-12-31 18:30:15.507 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,79c2c0a34788049c,370678763d9c67ea] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/hosts?null, client=10.108.139.108, traceId=79c2c0a34788049c, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listHosts(List,String,List,List,List,List,List,List,List,List,Pageable), args=Page request [number: 0, size 5000, sort: id: DESC],] 2024-12-31 18:30:15.512 WARN 34018 --- [http-nio-0.0.0.0-8090-exec-7,79c2c0a34788049c,370678763d9c67ea] o.h.h.internal.ast.QueryTranslatorImpl : HHH000104: firstResult/maxResults specified with collection fetch; applying in memory! 2024-12-31 18:30:15.519 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,8fec421e63032d46,df8c0654806a5b6c] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me/credentials client=10.108.139.108, traceId=8fec421e63032d46, duration=25 ms] 2024-12-31 18:30:15.568 INFO 34018 --- [prometheus-minute-schedule-1,51132564c8a2a085,01abb53364b218ea] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:15.570 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,79c2c0a34788049c,370678763d9c67ea] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hosts client=10.108.139.108, traceId=79c2c0a34788049c, duration=74 ms] 2024-12-31 18:30:16.252 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:16.254 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:16.592 WARN 34018 --- [ocp-async-10,6862f06f9e559f37,c0811e3344aab04a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:16.595 INFO 34018 --- [ocp-async-7,a67da115950fd8c3,263b6bc6aa9a125b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:18.457 INFO 34018 --- [ocp-schedules-4,fb6bd6f127b1dace,273b4f4a03b8dae0] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:30:18.458 INFO 34018 --- [ocp-schedules-19,c7806f2437947c3a,2b46b73abd4d0285] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:30:18.458 INFO 34018 --- [ocp-schedules-7,3f1cf2a3a12667af,b081817c2f201147] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:30:18.459 INFO 34018 --- [ocp-schedules-16,78cd8ecc9d38d536,eb4477dc9f926e04] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:30:18.465 INFO 34018 --- [ocp-schedules-13,f9cf3425f6e1e4b1,d9a310ac3b57658f] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:30:18.470 INFO 34018 --- [ocp-schedules-3,7830fc448652dba1,48ee45150b2adcd6] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:30:18.470 INFO 34018 --- [ocp-schedules-3,7830fc448652dba1,48ee45150b2adcd6] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:30:18.470 INFO 34018 --- [ocp-schedules-1,bf5710952f3baa05,6736673be8d421ba] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:30:18.470 INFO 34018 --- [ocp-schedules-1,bf5710952f3baa05,6736673be8d421ba] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:30:18.471 INFO 34018 --- [ocp-schedules-17,8c30bf4384d6fc40,d317d7e6b6d2b70a] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:30:18.471 INFO 34018 --- [ocp-schedules-17,8c30bf4384d6fc40,d317d7e6b6d2b70a] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:30:18.503 INFO 34018 --- [ocp-async-7,fe9d2c01890cd9c2,b175aac89234bcd4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:30:18.524 INFO 34018 --- [ocp-schedules-27,61a31a1d6ea74cfb,2176a182697fb819] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:30:18.568 INFO 34018 --- [prometheus-minute-schedule-1,e591a0755b0610aa,d26cddc51399acf3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:18.576 INFO 34018 --- [ocp-schedules-15,90fff6f9f5cba00a,f3aef4d194b4c99a] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:30:18.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:30:18.588932+08:00, lastProcessTime=2024-12-31T18:30:08.587111+08:00 2024-12-31 18:30:18.592 WARN 34018 --- [ocp-async-4,dfac90179030629a,ac944d94105f75a3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:18.595 INFO 34018 --- [ocp-async-9,ac7da0bbe4ec9852,810edbf8ae159465] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:18.771 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:30:18.588932+08:00 2024-12-31 18:30:19.254 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:19.256 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:20.592 WARN 34018 --- [ocp-async-3,c70ad69237a6b375,109fcda89290815a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:20.595 INFO 34018 --- [ocp-async-5,39f19aca60bca508,2d06a9a0baa9e7fe] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:21.568 INFO 34018 --- [prometheus-minute-schedule-1,deb6a4ccaf863d8d,c5a9399e170368e5] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:21.977 INFO 34018 --- [ocp-schedules-12,554f4567a3517b77,98f1123224ebcd08] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:30:22.256 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:22.258 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:22.592 WARN 34018 --- [ocp-async-10,08c970d74456fafc,4dfb6c4692bf5375] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:22.595 INFO 34018 --- [ocp-async-7,6f64cfa2850bcc42,189fa54d157de483] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:24.568 INFO 34018 --- [prometheus-minute-schedule-1,83d454cc785f2674,acaf78c3fc685254] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:24.592 WARN 34018 --- [ocp-async-1,da9a50f9057ab25e,accbb7cf5069ec65] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:24.595 INFO 34018 --- [ocp-async-4,8657e82c0f2af0e6,e374c6672fc105ef] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:25.258 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:25.260 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:26.592 WARN 34018 --- [ocp-async-9,33794f7824529be2,83267a6a49e8caf1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:26.596 INFO 34018 --- [ocp-async-6,cf07228e2165ca33,641305e5e3917d62] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:27.568 INFO 34018 --- [prometheus-minute-schedule-1,ca2acd765740ee53,a389ea3e8012119e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:28.260 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:28.262 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:28.503 INFO 34018 --- [ocp-async-6,40f743d70575fc08,40545f3f21f8d9a6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:30:28.524 INFO 34018 --- [ocp-schedules-16,b0faaceebc9b4522,d180dd247d04346f] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:30:28.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:30:28.589072+08:00, lastProcessTime=2024-12-31T18:30:18.588932+08:00 2024-12-31 18:30:28.593 WARN 34018 --- [ocp-async-10,e8c2722fb61fd7b9,0084e2e7abde9398] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:28.596 INFO 34018 --- [ocp-async-7,560225e41179d190,24405901469f2e75] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:28.760 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:30:28.589072+08:00 2024-12-31 18:30:29.260 INFO 34018 --- [ocp-schedules-10,6544be14eae7527b,9ba119154e3b189f] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:30:29.270 INFO 34018 --- [ocp-schedules-10,6544be14eae7527b,9ba119154e3b189f] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:30:29.270 INFO 34018 --- [ocp-schedules-10,6544be14eae7527b,9ba119154e3b189f] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:30:30.568 INFO 34018 --- [prometheus-minute-schedule-1,2a7185cbca172cc7,650e83115ff5fca1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:30.593 WARN 34018 --- [ocp-async-1,3b169c6acaa288d3,08c6185dd40f8713] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:30.599 INFO 34018 --- [ocp-async-4,ef124f9ac2a83296,4ecf758281ce2055] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:31.262 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:31.264 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:32.021 INFO 34018 --- [ocp-schedules-26,47817df21667904a,81737fa5a35e9faf] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:30:32.593 WARN 34018 --- [ocp-async-3,73f40a74eff76d58,efd08e1279f539c9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:32.599 INFO 34018 --- [ocp-async-6,d9504214406ae53a,ff1218dcb35cad30] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:33.568 INFO 34018 --- [prometheus-minute-schedule-1,1c3b900240b83100,2a4901ceec496023] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:34.264 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:34.266 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:34.593 WARN 34018 --- [ocp-async-10,ae71172d48bd04d1,3603af768f90aa9e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:34.599 INFO 34018 --- [ocp-async-8,b1a06820ef7db709,7644177ddd114001] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:36.476 INFO 34018 --- [pool-15-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2024-12-31T18:24:36.441, end=2024-12-31T18:29:36.466} 2024-12-31 18:30:36.477 INFO 34018 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2024-12-31T18:24:36.441, end=2024-12-31T18:29:36.466} 2024-12-31 18:30:36.489 INFO 34018 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER : for [] 2024-12-31 18:30:36.489 INFO 34018 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2024-12-31 18:30:36.489 INFO 34018 --- [pool-15-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER : for [] 2024-12-31 18:30:36.489 INFO 34018 --- [pool-15-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2024-12-31 18:30:36.568 INFO 34018 --- [prometheus-minute-schedule-1,83dc585f73db0919,74de6534e0215507] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:36.569 INFO 34018 --- [prometheus-cache-monitor1,90fb1e9448d1961d,e7359ecde58d4ec0] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1418,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":367,"seriesIdKeySize":367,"secondWriteQueue":0,"minuteWriteCacheSize":362} 2024-12-31 18:30:36.569 INFO 34018 --- [prometheus-cache-monitor1,90fb1e9448d1961d,e7359ecde58d4ec0] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=41, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, http_server_requests_seconds_count=41, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:30:36.594 WARN 34018 --- [ocp-async-1,d940a64c61050008,a039d5f94f950b7b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:36.600 INFO 34018 --- [ocp-async-2,9cabf506f129e9c0,8a164426ef4540e9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:36.662 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2024-12-31T18:26:36.643, end=2024-12-31T18:28:36.659} 2024-12-31 18:30:36.665 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [] 2024-12-31 18:30:36.665 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2024-12-31 18:30:37.266 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:37.268 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:38.503 INFO 34018 --- [ocp-async-2,bacabb951324fab0,f30273013bd4fad0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:30:38.524 INFO 34018 --- [ocp-schedules-15,a079f44df8ca7e6d,90ec9e588f4225c9] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:30:38.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:30:38.589342+08:00, lastProcessTime=2024-12-31T18:30:28.589072+08:00 2024-12-31 18:30:38.594 WARN 34018 --- [ocp-async-9,20e627f7f899934b,4184c9f5fff732de] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:38.600 INFO 34018 --- [ocp-async-5,aabc455a5b08a470,27165462a849fa5a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:38.748 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:30:38.589342+08:00 2024-12-31 18:30:39.568 INFO 34018 --- [prometheus-minute-schedule-1,176818a9ddc2c088,49a3a3d18fed6469] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:40.004 INFO 34018 --- [ocp-schedules-5,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:30:40.004 INFO 34018 --- [ocp-schedules-1,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:30:40.268 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:40.271 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:40.427 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,233f4979c827abe4,90119f4e22d78284] c.o.o.s.c.c.s.utils.CsrfRequestMatcher : CSRF token required for API [POST /api/v2/profiles/me/credentials, client 10.108.139.108, traceId 233f4979c827abe4] 2024-12-31 18:30:40.454 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,233f4979c827abe4,90119f4e22d78284] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /api/v2/profiles/me/credentials?null, client=10.108.139.108, traceId=233f4979c827abe4, method=SuccessResponse com.oceanbase.ocp.server.common.controller.CredentialController.createCredential(CreateCredentialParam), args=CreateCredentialParam(targetType=HOST, validate=true, name=userpassword, description=, obJdbcCredentialProperty=ObJdbcCredentialProperty(clusterId=null, tenantId=null, clusterName=null, tenantName=null, username=null), sshCredentialProperty=SshCredentialProperty(type=PASSWORD, allowSudo=true, username=admin, passphrase=xxx hostIdList=[], localPrivateKeyPath=null), agentCredentialProperty=null),] 2024-12-31 18:30:40.485 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,233f4979c827abe4,90119f4e22d78284] c.o.o.s.c.CredentialServiceImpl : Begin to create or replace credential:CreateCredentialParam(targetType=HOST, validate=true, name=userpassword, description=, obJdbcCredentialProperty=ObJdbcCredentialProperty(clusterId=null, tenantId=null, clusterName=null, tenantName=null, username=null), sshCredentialProperty=SshCredentialProperty(type=PASSWORD, allowSudo=true, username=admin, passphrase=oceanbase, hostIdList=[], localPrivateKeyPath=null), agentCredentialProperty=null) 2024-12-31 18:30:40.486 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,233f4979c827abe4,90119f4e22d78284] c.o.o.s.c.CredentialServiceImpl : Validating credential:ValidateCredentialParam(targetType=HOST, obJdbcCredentialProperty=ObJdbcCredentialProperty(clusterId=null, tenantId=null, clusterName=null, tenantName=null, username=null), sshCredentialProperty=SshCredentialProperty(type=PASSWORD, allowSudo=true, username=admin, passphrase=oceanbase, hostIdList=[], localPrivateKeyPath=null), agentCredentialProperty=null, batchSshValidateProperty=null) 2024-12-31 18:30:40.594 WARN 34018 --- [ocp-async-6,b81bf9e076572712,0f24c24025c80f90] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:40.600 INFO 34018 --- [ocp-async-8,faa2910639c7c60f,f05fefd94f64d5be] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:40.929 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,233f4979c827abe4,90119f4e22d78284] c.o.o.s.c.CredentialServiceImpl : Success to create or replace credential:CreateCredentialParam(targetType=HOST, validate=true, name=userpassword, description=, obJdbcCredentialProperty=ObJdbcCredentialProperty(clusterId=null, tenantId=null, clusterName=null, tenantName=null, username=null), sshCredentialProperty=SshCredentialProperty(type=PASSWORD, allowSudo=true, username=admin, passphrase=oceanbase, hostIdList=[], localPrivateKeyPath=null), agentCredentialProperty=null) 2024-12-31 18:30:40.937 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,233f4979c827abe4,90119f4e22d78284] c.o.ocp.service.audit.AuditEventService : begin create audit event, param:CreateAuditEventParam(operationEvent=CREATE_CREDENTIAL, eventType=CREDENTIAL_MANAGEMENT, methodSignature=com.oceanbase.ocp.server.common.controller.CredentialController.createCredential, resourceType=CREDENTIAL, resources=[CreateAuditEventParam.AuditResourceParam(resourceId=null, resourceName=userpassword, parentResource=null)], operatorId=100, operatorName=admin, status=SUCCESS, failedReason=null, taskId=null, eventInfo={"param":{"description":"","name":"userpassword","obJdbcCredentialProperty":{},"sshCredentialProperty":{"allowSudo":true,"hostIdList":[],"passphrase":"******","type":"PASSWORD","username":"admin"},"targetType":"HOST","validate":true}}, executionType=NEW, requestUrl=http://10.79.169.37:8090/api/v2/profiles/me/credentials, clientIp=10.108.139.108, serverIp=10.79.169.37, startTime=2024-12-31T18:30:40.477+08:00, endTime=2024-12-31T18:30:40.935+08:00, role=null, aliUid=null) 2024-12-31 18:30:40.989 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,233f4979c827abe4,90119f4e22d78284] c.o.o.s.c.trace.RequestTracingAspect : API OK: [POST /api/v2/profiles/me/credentials client=10.108.139.108, traceId=233f4979c827abe4, duration=569 ms] 2024-12-31 18:30:41.496 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,a39fef32e2fd1ed5,c04ae66b5fc6288d] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me/credentials?targetType=HOST, client=10.108.139.108, traceId=a39fef32e2fd1ed5, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.CredentialController.listCredentials(AccessTargetType,String,Pageable), args=HOST,Page request [number: 0, size 5000, sort: createTime: DESC],] 2024-12-31 18:30:41.515 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,a39fef32e2fd1ed5,c04ae66b5fc6288d] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me/credentials client=10.108.139.108, traceId=a39fef32e2fd1ed5, duration=26 ms] 2024-12-31 18:30:42.065 INFO 34018 --- [ocp-schedules-19,fcee0951f2c0c5f0,fbd1e89d03d80abc] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:30:42.568 INFO 34018 --- [prometheus-minute-schedule-1,51b6eec35c95ea1f,898200c35caa3378] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:42.594 WARN 34018 --- [ocp-async-1,7409bcf42bdfd4c4,0a51b61c451a08cc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:42.600 INFO 34018 --- [ocp-async-2,df39efebe5220236,66bd72e65812a5cf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:43.271 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:43.272 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:44.594 WARN 34018 --- [ocp-async-9,9089eefe27f89a40,b5be2a5b0ef405c8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:44.600 INFO 34018 --- [ocp-async-3,56ae8f7fe90aed81,9701bf8a7771d067] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:44.848 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,78ddcdb65b88e3ee,6d2b03f400a40a25] c.o.o.s.c.c.s.utils.CsrfRequestMatcher : CSRF token required for API [POST /api/v2/profiles/me/credentials/validate, client 10.108.139.108, traceId 78ddcdb65b88e3ee] 2024-12-31 18:30:44.862 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,78ddcdb65b88e3ee,6d2b03f400a40a25] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /api/v2/profiles/me/credentials/validate?null, client=10.108.139.108, traceId=78ddcdb65b88e3ee, method=SuccessResponse com.oceanbase.ocp.server.common.controller.CredentialController.validateConnect(ValidateCredentialParam), args=ValidateCredentialParam(targetType=HOST, obJdbcCredentialProperty=null, sshCredentialProperty=null, agentCredentialProperty=null, batchSshValidateProperty=BatchSshValidateProperty(addressPairs=[BatchSshValidateProperty.AddressPair(hostAddress=10.79.169.37, sshPort=22, vpcId=1), BatchSshValidateProperty.AddressPair(hostAddress=10.79.169.36, sshPort=22, vpcId=1), BatchSshValidateProperty.AddressPair(hostAddress=10.79.169.38, sshPort=22, vpcId=1)], type=null, username=null, passphrase=xxx allowSudo=true, changepassphrase=xxx credentialId=1, localPrivateKeyPath=null)),] 2024-12-31 18:30:44.888 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,78ddcdb65b88e3ee,6d2b03f400a40a25] c.o.o.s.c.CredentialServiceImpl : Batch validate credential SshSecret(type=PASSWORD, allowSudo=true, username=admin, hosts=[], localPrivateKeyPath=null) for connecting hosts: [BatchSshValidateProperty.AddressPair(hostAddress=10.79.169.37, sshPort=22, vpcId=1), BatchSshValidateProperty.AddressPair(hostAddress=10.79.169.36, sshPort=22, vpcId=1), BatchSshValidateProperty.AddressPair(hostAddress=10.79.169.38, sshPort=22, vpcId=1)] 2024-12-31 18:30:44.901 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] c.o.o.e.internal.connector.Connectors : init global connector holder. 2024-12-31 18:30:44.902 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] c.o.o.e.i.connector.ConnectorHolder : Init connector holder, maxIdleSecs=3600 2024-12-31 18:30:45.461 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] n.s.sshj.transport.random.JCERandom : Creating new SecureRandom. 2024-12-31 18:30:45.461 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] n.s.sshj.transport.random.JCERandom : Creating new SecureRandom. 2024-12-31 18:30:45.461 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] n.s.sshj.transport.random.JCERandom : Creating new SecureRandom. 2024-12-31 18:30:45.568 INFO 34018 --- [prometheus-minute-schedule-1,fa9e1390f50694bb,c42598f8bf1cea48] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:45.709 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] n.schmizz.sshj.transport.TransportImpl : Client identity string: SSH-2.0-SSHJ_0.34.0 2024-12-31 18:30:45.709 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] n.schmizz.sshj.transport.TransportImpl : Client identity string: SSH-2.0-SSHJ_0.34.0 2024-12-31 18:30:45.709 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] n.schmizz.sshj.transport.TransportImpl : Client identity string: SSH-2.0-SSHJ_0.34.0 2024-12-31 18:30:45.723 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] n.schmizz.sshj.transport.TransportImpl : Server identity string: SSH-2.0-OpenSSH_7.4 2024-12-31 18:30:45.728 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] n.schmizz.sshj.transport.TransportImpl : Server identity string: SSH-2.0-OpenSSH_7.4 2024-12-31 18:30:45.735 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] n.schmizz.sshj.transport.TransportImpl : Server identity string: SSH-2.0-OpenSSH_7.4 2024-12-31 18:30:46.055 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] com.oceanbase.ocp.common.ssh.SshChannel : Connected ssh to host 10.79.169.37:22 success 2024-12-31 18:30:46.056 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] com.oceanbase.ocp.common.ssh.SshChannel : Connected ssh to host 10.79.169.38:22 success 2024-12-31 18:30:46.056 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] com.oceanbase.ocp.common.ssh.SshChannel : Connected ssh to host 10.79.169.36:22 success 2024-12-31 18:30:46.140 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] com.oceanbase.ocp.common.ssh.SshChannel : Success to init SSHClient by PASSWORD, host: admin@10.79.169.36 2024-12-31 18:30:46.140 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] com.oceanbase.ocp.common.ssh.SshChannel : Success to init SSHClient by PASSWORD, host: admin@10.79.169.37 2024-12-31 18:30:46.141 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] c.o.o.e.i.connector.ConnectorHolder : [ConnectorHolder]: connector put to cache, key=ConnectorKey(protocol=ssh, hostAddress=10.79.169.36, httpPort=null, sshPort=22, authentication=Authentication(httpAuth=null, sshAuth=SshAuthentication(authType=password, passwordAuthConfig=PasswordAuthConfig(username=admin), privateKeyAuthConfig=null)), proxy=null), estimated size:2 2024-12-31 18:30:46.141 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] c.o.o.e.i.connector.ConnectorHolder : [ConnectorHolder]: connector put to cache, key=ConnectorKey(protocol=ssh, hostAddress=10.79.169.37, httpPort=null, sshPort=22, authentication=Authentication(httpAuth=null, sshAuth=SshAuthentication(authType=password, passwordAuthConfig=PasswordAuthConfig(username=admin), privateKeyAuthConfig=null)), proxy=null), estimated size:1 2024-12-31 18:30:46.161 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] com.oceanbase.ocp.common.ssh.SshChannel : Success to init SSHClient by PASSWORD, host: admin@10.79.169.38 2024-12-31 18:30:46.161 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] c.o.o.e.i.connector.ConnectorHolder : [ConnectorHolder]: connector put to cache, key=ConnectorKey(protocol=ssh, hostAddress=10.79.169.38, httpPort=null, sshPort=22, authentication=Authentication(httpAuth=null, sshAuth=SshAuthentication(authType=password, passwordAuthConfig=PasswordAuthConfig(username=admin), privateKeyAuthConfig=null)), proxy=null), estimated size:3 2024-12-31 18:30:46.215 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:30:46.248 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.273 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:46.275 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:46.277 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:30:46.297 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.297 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] c.o.o.e.internal.template.SshTemplate : SSH execute end: echo 1 on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.336 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:30:46.359 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.398 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo -n true on 10.79.169.36 2024-12-31 18:30:46.415 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:30:46.443 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.458 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo -n true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=sudo -n true, out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.458 INFO 34018 --- [pool-20-thread-2,78ddcdb65b88e3ee,118259a453329eea] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo -n true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=sudo -n true, out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.481 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:30:46.502 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.502 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] c.o.o.e.internal.template.SshTemplate : SSH execute end: echo 1 on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.542 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:30:46.563 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.593 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:30:46.594 WARN 34018 --- [ocp-async-5,658be14f61e1a061,c888bec5bfdb7fa8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:46.601 INFO 34018 --- [ocp-async-10,94d47fe20b604fe8,d74f22e77add53ea] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:46.602 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo -n true on 10.79.169.37 2024-12-31 18:30:46.633 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.661 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo -n true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=sudo -n true, out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.661 INFO 34018 --- [pool-20-thread-1,78ddcdb65b88e3ee,342f0d7c058b543e] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo -n true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=sudo -n true, out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.672 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:30:46.702 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.702 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] c.o.o.e.internal.template.SshTemplate : SSH execute end: echo 1 on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.741 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:30:46.767 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:46.806 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo -n true on 10.79.169.38 2024-12-31 18:30:47.370 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo -n true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=sudo -n true, out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:47.370 INFO 34018 --- [pool-20-thread-3,78ddcdb65b88e3ee,4918ea978ccf0de2] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo -n true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=sudo -n true, out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:47.372 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,78ddcdb65b88e3ee,6d2b03f400a40a25] c.o.o.s.c.trace.RequestTracingAspect : API OK: [POST /api/v2/profiles/me/credentials/validate client=10.108.139.108, traceId=78ddcdb65b88e3ee, duration=2530 ms] 2024-12-31 18:30:48.456 INFO 34018 --- [ocp-schedules-11,13f4dff6b0020035,3e2c7b2e3e2ce0eb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:30:48.457 INFO 34018 --- [ocp-schedules-16,107057d3fe89f77a,992641f2b48f974f] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:30:48.457 INFO 34018 --- [ocp-schedules-2,f1e968425d8f4596,b8e6107d709b9c66] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:30:48.458 INFO 34018 --- [ocp-schedules-20,8aae68a51db6d0cd,5788a289079505da] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:30:48.458 INFO 34018 --- [ocp-schedules-3,a4e06616d38d253e,073a9e3c0db23578] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:30:48.459 INFO 34018 --- [ocp-schedules-5,6876742a977d8b59,59370c9954a4ac15] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:30:48.465 INFO 34018 --- [ocp-schedules-11,13f4dff6b0020035,3e2c7b2e3e2ce0eb] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:30:48.466 INFO 34018 --- [ocp-schedules-23,637101c30ffd9e79,c8d9018678c13a34] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:30:48.466 INFO 34018 --- [ocp-schedules-3,a4e06616d38d253e,073a9e3c0db23578] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:30:48.481 INFO 34018 --- [ocp-schedules-7,48de526edd72d1d5,4267b67e9baed08f] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:30:48.481 INFO 34018 --- [ocp-schedules-7,48de526edd72d1d5,4267b67e9baed08f] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:30:48.481 INFO 34018 --- [ocp-schedules-19,84c6c136fcec349a,91139fd089c3bc2c] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:30:48.482 INFO 34018 --- [ocp-schedules-19,84c6c136fcec349a,91139fd089c3bc2c] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:30:48.482 INFO 34018 --- [ocp-schedules-29,762886f5d25827f4,ccf15cda6218041b] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:30:48.482 INFO 34018 --- [ocp-schedules-29,762886f5d25827f4,ccf15cda6218041b] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:30:48.503 INFO 34018 --- [ocp-async-1,4ba02899555d49c0,bee5d1e425811385] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:30:48.513 INFO 34018 --- [ocp-schedules-17,f32ef683fd44e5cb,91eea7c94cec3140] c.o.o.a.service.OcpAlarmInspectService : delete inactive alarm event count 0 2024-12-31 18:30:48.513 INFO 34018 --- [ocp-schedules-17,f32ef683fd44e5cb,91eea7c94cec3140] c.o.o.a.service.OcpAlarmInspectService : deleteInactiveAlarmEvents count 0 2024-12-31 18:30:48.521 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.s.c.c.s.utils.CsrfRequestMatcher : CSRF token required for API [POST /api/v2/ob/clusters/takeOver, client 10.108.139.108, traceId 533c711d5df1d20e] 2024-12-31 18:30:48.524 INFO 34018 --- [ocp-schedules-26,ac3802d83f44dc5a,f1312f39b48c7ecc] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:30:48.531 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /api/v2/ob/clusters/takeOver?null, client=10.108.139.108, traceId=533c711d5df1d20e, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ObClusterController.takeOverObCluster(TakeOverClusterParam), args=TakeOverClusterParam(switchConfigUrl=true, hostInfo=TakeOverClusterParam.HostInfo(kind=DEDICATED_PHYSICAL_MACHINE, publishPorts=null, hostTypeId=1, sshPort=22, credentialId=1)),] 2024-12-31 18:30:48.546 INFO 34018 --- [ocp-schedules-28,600d96f4bed4f6bf,53354632c0a860af] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: hostQueryCache 2024-12-31 18:30:48.546 INFO 34018 --- [ocp-schedules-28,600d96f4bed4f6bf,53354632c0a860af] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2024-12-31 18:30:48.548 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=ob-cluster-10.79.169.37#2883, method=takeOverCluster 2024-12-31 18:30:48.549 INFO 34018 --- [ocp-schedules-6,1dc9c028a27f8086,55661c4dc5dd2eee] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:30:48.549+08:00, clusters=[] 2024-12-31 18:30:48.554 INFO 34018 --- [ocp-schedules-28,600d96f4bed4f6bf,53354632c0a860af] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2024-12-31 18:30:48.554 INFO 34018 --- [ocp-schedules-28,600d96f4bed4f6bf,53354632c0a860af] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obQueryCache 2024-12-31 18:30:48.554 INFO 34018 --- [ocp-schedules-28,600d96f4bed4f6bf,53354632c0a860af] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2024-12-31 18:30:48.557 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.558 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2024-12-31 18:30:48.559 INFO 34018 --- [ocp-schedules-12,5ad541ce14e17509,3d2aa249665cf6a8] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:30:48.562 INFO 34018 --- [ocp-schedules-8,1004bc3c47d46372,e78ae6f99498250f] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:30:48.562 INFO 34018 --- [ocp-schedules-30,29df83f38da9c71b,f5f9efeb1ac94954] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:30:48.562 INFO 34018 --- [ocp-schedules-30,29df83f38da9c71b,f5f9efeb1ac94954] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:30:48.562 INFO 34018 --- [ocp-schedules-28,600d96f4bed4f6bf,53354632c0a860af] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2024-12-31 18:30:48.562 INFO 34018 --- [ocp-schedules-28,600d96f4bed4f6bf,53354632c0a860af] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obProxyQueryCache 2024-12-31 18:30:48.562 INFO 34018 --- [ocp-schedules-28,600d96f4bed4f6bf,53354632c0a860af] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2024-12-31 18:30:48.562 INFO 34018 --- [ocp-schedules-2,c7df1ccafcd8b97d,0bcecddd53040b70] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:30:48.562 INFO 34018 --- [ocp-schedules-2,c7df1ccafcd8b97d,0bcecddd53040b70] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:30:48.563 INFO 34018 --- [ocp-schedules-13,a3fd881666116c7e,8b9e9aab778ee3fc] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:30:48.563+08:00, clusters=[] 2024-12-31 18:30:48.563 INFO 34018 --- [ocp-schedules-13,c0e42440a68cc02b,a2edd5a94488e7ea] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:30:48.564 INFO 34018 --- [ocp-schedules-30,29df83f38da9c71b,f5f9efeb1ac94954] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:30:48.564 INFO 34018 --- [ocp-schedules-30,29df83f38da9c71b,f5f9efeb1ac94954] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:30:48.565 INFO 34018 --- [ocp-schedules-16,4852a8191302b6c8,e049f0dc2c719e13] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:30:48.565 INFO 34018 --- [ocp-schedules-28,600d96f4bed4f6bf,53354632c0a860af] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2024-12-31 18:30:48.568 INFO 34018 --- [prometheus-minute-schedule-1,9b4b83930172389b,afe42d478ba3a410] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:48.570 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.571 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster] 2024-12-31 18:30:48.575 INFO 34018 --- [ocp-schedules-30,b841c4e16cbe1762,fad530997a1909d7] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[] 2024-12-31 18:30:48.575 INFO 34018 --- [ocp-schedules-30,b841c4e16cbe1762,fad530997a1909d7] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms finished. 2024-12-31 18:30:48.578 INFO 34018 --- [ocp-schedules-3,0bfa7e226946e2c8,aa4d9e38e48db9cf] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:30:48.588 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.588 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:30:48.587802+08:00, lastProcessTime=2024-12-31T18:30:38.589342+08:00 2024-12-31 18:30:48.588 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [cluster_id] 2024-12-31 18:30:48.595 WARN 34018 --- [ocp-async-2,6dc03e75b729f4e7,4128be05b0cc2e12] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:48.595 INFO 34018 --- [ocp-schedules-11,5a26a7581e8a47bf,d94841eb4cf1a470] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:30:48.598 INFO 34018 --- [ocp-schedules-11,5a26a7581e8a47bf,d94841eb4cf1a470] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:30:48.598 INFO 34018 --- [ocp-schedules-11,5a26a7581e8a47bf,d94841eb4cf1a470] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 0 2024-12-31 18:30:48.601 INFO 34018 --- [ocp-async-4,bd57d241686f8394,c3603ee4274f400f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:48.603 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.604 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [obconfig_url] 2024-12-31 18:30:48.619 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.620 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2024-12-31 18:30:48.629 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.629 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE 2024-12-31 18:30:48.630 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.631 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2024-12-31 18:30:48.672 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.673 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [data_dir] 2024-12-31 18:30:48.677 INFO 34018 --- [ocp-schedules-9,33ffb155ed3bf7af,c0004d28187a6300] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:30:48.677 INFO 34018 --- [ocp-schedules-9,33ffb155ed3bf7af,c0004d28187a6300] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:30:48.679 INFO 34018 --- [ocp-schedules-9,33ffb155ed3bf7af,c0004d28187a6300] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:30:48.679 INFO 34018 --- [ocp-schedules-9,33ffb155ed3bf7af,c0004d28187a6300] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:30:48.680 INFO 34018 --- [ocp-schedules-9,33ffb155ed3bf7af,c0004d28187a6300] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:30:48.680 INFO 34018 --- [ocp-schedules-9,33ffb155ed3bf7af,c0004d28187a6300] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730653811830194176 2024-12-31 18:30:48.683 INFO 34018 --- [ocp-schedules-9,33ffb155ed3bf7af,c0004d28187a6300] c.o.ocp.monitor.service.IdKeyService : Sync record key and id, newRecordIdsCount=4, maxSyncedRecordId=730654063467462656 2024-12-31 18:30:48.689 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.690 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES` 2024-12-31 18:30:48.701 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.705 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(`status`) as `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC 2024-12-31 18:30:48.710 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.HintQueryer : add hints for sql, hints=[query_timeout(60000000)], after=SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2024-12-31 18:30:48.710 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.715 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT /*+ query_timeout(60000000) */ TENANT_ID, TENANT_NAME, TENANT_TYPE, PRIMARY_ZONE, LOCALITY, COMPATIBILITY_MODE, STATUS, IN_RECYCLEBIN, (CASE WHEN LOCKED = 'YES' THEN 1 ELSE 0 END) AS LOCKED, TIMESTAMPDIFF(SECOND, CREATE_TIME, now()) AS exist_seconds , ARBITRATION_SERVICE_STATUS, REPLACE(`SWITCHOVER_STATUS`, ' ', '_') as SWITCHOVER_STATUS, LOG_MODE, SYNC_SCN, RECOVERY_UNTIL_SCN, TENANT_ROLE FROM oceanbase.DBA_OB_TENANTS WHERE TENANT_TYPE IN ('SYS', 'USER') 2024-12-31 18:30:48.724 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:30:48.587802+08:00 2024-12-31 18:30:48.737 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.738 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2024-12-31 18:30:48.775 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.776 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1] 2024-12-31 18:30:48.812 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.813 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1] 2024-12-31 18:30:48.819 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.820 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2024-12-31 18:30:48.858 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.859 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1002] 2024-12-31 18:30:48.900 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.901 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1002] 2024-12-31 18:30:48.907 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.908 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2024-12-31 18:30:48.953 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.954 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, NAME, VALUE FROM oceanbase.CDB_OB_SYS_VARIABLES WHERE TENANT_ID = ?, args: [1004] 2024-12-31 18:30:48.993 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:48.994 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT TENANT_ID, SERVICE_NAME, SERVICE_STATUS FROM CDB_OB_SERVICES WHERE TENANT_ID = ?, args: [1004] 2024-12-31 18:30:49.012 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:49.013 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT COUNT(1) FROM information_schema.TABLES WHERE TABLE_SCHEMA = 'ocp' AND TABLE_NAME = 'ops_config' 2024-12-31 18:30:49.041 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:49.041 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version' 2024-12-31 18:30:49.052 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:49.052 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:30:49.053 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:49.053 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:30:49.054 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:49.054 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [rootservice_list] 2024-12-31 18:30:49.065 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:49.066 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [rootservice_list] 2024-12-31 18:30:49.092 ERROR 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.NotFoundException occurred with code error.compute.host.ip.not.found, and args [class com.oceanbase.ocp.core.metadb.repo.compute.host.entity.HostEntity, 10.79.169.37] 2024-12-31 18:30:49.102 ERROR 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.NotFoundException occurred with code error.compute.host.ip.not.found, and args [class com.oceanbase.ocp.core.metadb.repo.compute.host.entity.HostEntity, 10.79.169.36] 2024-12-31 18:30:49.112 ERROR 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.NotFoundException occurred with code error.compute.host.ip.not.found, and args [class com.oceanbase.ocp.core.metadb.repo.compute.host.entity.HostEntity, 10.79.169.38] 2024-12-31 18:30:49.180 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.c.host.service.RegionServiceImpl : Created region: 2 sys_region 2024-12-31 18:30:49.202 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.c.host.service.IdcServiceImpl : Created idc: 1 idc1 2024-12-31 18:30:49.273 INFO 34018 --- [ocp-schedules-21,52a4f9223520119c,619aa2edbfe2aca7] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:30:49.275 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:49.276 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:49.280 INFO 34018 --- [ocp-schedules-21,52a4f9223520119c,619aa2edbfe2aca7] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:30:49.280 INFO 34018 --- [ocp-schedules-21,52a4f9223520119c,619aa2edbfe2aca7] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:30:49.316 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.c.host.service.IdcServiceImpl : Created idc: 2 idc3 2024-12-31 18:30:49.337 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.c.host.service.IdcServiceImpl : Created idc: 3 idc2 2024-12-31 18:30:49.377 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.o.i.c.ClusterGroupServiceImpl : create cluster group, name=myoceanbase, description=myoceanbase, create by cluster service, affectedRows=1 2024-12-31 18:30:49.454 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.s.c.CredentialServiceImpl : Begin to create or replace credential:CreateCredentialParam(targetType=OB, validate=false, name=null, description=null, obJdbcCredentialProperty=ObJdbcCredentialProperty(clusterId=1, tenantId=null, clusterName=myoceanbase, tenantName=sys, username=root), sshCredentialProperty=null, agentCredentialProperty=null) 2024-12-31 18:30:49.625 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.s.c.CredentialServiceImpl : Success to create or replace credential:CreateCredentialParam(targetType=OB, validate=false, name=null, description=null, obJdbcCredentialProperty=ObJdbcCredentialProperty(clusterId=1, tenantId=null, clusterName=myoceanbase, tenantName=sys, username=root), sshCredentialProperty=null, agentCredentialProperty=null) 2024-12-31 18:30:49.625 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.s.c.CredentialServiceImpl : Begin to create or replace credential:CreateCredentialParam(targetType=OB, validate=false, name=null, description=null, obJdbcCredentialProperty=ObJdbcCredentialProperty(clusterId=1, tenantId=null, clusterName=myoceanbase, tenantName=sys, username=root), sshCredentialProperty=null, agentCredentialProperty=null) 2024-12-31 18:30:49.628 WARN 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.s.c.CredentialServiceImpl : Credential clusterName=myoceanbase|tenantName=sys|username=root is already exists 2024-12-31 18:30:49.628 WARN 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.s.c.CredentialServiceImpl : Delete credential:clusterName=myoceanbase|tenantName=sys|username=root 2024-12-31 18:30:49.650 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.s.c.CredentialServiceImpl : Success to create or replace credential:CreateCredentialParam(targetType=OB, validate=false, name=null, description=null, obJdbcCredentialProperty=ObJdbcCredentialProperty(clusterId=1, tenantId=null, clusterName=myoceanbase, tenantName=sys, username=root), sshCredentialProperty=null, agentCredentialProperty=null) 2024-12-31 18:30:49.651 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:49.651 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:30:49.652 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:49.653 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:30:49.653 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:49.654 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [rootservice_list] 2024-12-31 18:30:49.665 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:30:49.666 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = 'cluster' AND name LIKE ? , args: [rootservice_list] 2024-12-31 18:30:49.681 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.o.i.c.ClusterOperationServiceImpl : meta cluster detected. 2024-12-31 18:30:49.780 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.s.c.event.CmdbSyncEventPublisher : [CMDB]:Publish cmdb sync event:UPDATE APP GROUP, property:UpdateAppGroupProperty(serialNumbers=[null, null, null], appGroup=myoceanbase) 2024-12-31 18:30:50.595 WARN 34018 --- [ocp-async-5,a2b965e5892ad06f,495d9d6fedc6df73] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:50.602 INFO 34018 --- [ocp-async-10,a327bae18eb58a79,0d8aeb68c6bcfec4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:50.855 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.c.distributed.event.EventUpdater : [OCP116301] distributed event published by a9efd8d51e, eventId=1, event=RefreshClusterCacheEvent{name=refresh-config-server-cache, payload=["myoceanbase"]} 2024-12-31 18:30:50.864 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.c.t.e.c.worker.SubtaskGenerator : generate tasks, templateName=Take over primary OB cluster, nodeCount=41, taskCount=67 2024-12-31 18:30:50.864 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Save task instance, entity=TaskInstanceEntity{id=null, name='Take over primary OB cluster', taskDefinitionId=-1, state=RUNNING, type=MANUAL, clusterId=1, tenantId=null, hostId=null, creator='admin', executor='10.79.169.37', argument=Argument{parallelIdx=-1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, ssh_port=22, prohibit_rollback=false, service_name=myoceanbase:1735638920, ob_connect_address=10.79.169.37:2883, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, createTime=null, startTime=2024-12-31T18:30:50.864+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=null, name=Pre check for create host, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.host.PreCreateHostCheckTask, seriesId=58, startTime=null, endTime=null}, SubtaskInstanceEntity{id=null, name=Update zone status, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.zone.UpdateObZoneStatusTask, seriesId=9, startTime=null, endTime=null}, SubtaskInstanceEntity{id=null, name=Active agent modules, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.obagent.ActiveAgentModuleTask, seriesId=19, startTime=null, endTime=null}, SubtaskInstanceEntity{id=null, name=Run io calibration, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.cluster.RunIoCalibrationJobTask, seriesId=26, startTime=null, endTime=null}, SubtaskInstanceEntity{id=null, name=Attach cluster attributes, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.cluster.AttachClusterAttributesTask, seriesId=28, startTime=null, endTime=n 2024-12-31 18:30:51.024 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=49} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=3, svrIp='10.79.169.36', deleted=false, createTime=null} 2024-12-31 18:30:51.050 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=25} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=1, svrIp='10.79.169.37', deleted=false, createTime=null} 2024-12-31 18:30:51.060 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=42} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=2, svrIp='10.79.169.38', deleted=false, createTime=null} 2024-12-31 18:30:51.062 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=28} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=3, svrIp='10.79.169.36', deleted=false, createTime=null} 2024-12-31 18:30:51.079 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=34} BaseTagEntity{id=null, clusterName='myoceanbase', clusterId=1, obClusterId=1735638920, zoneName='zone3', tenantName='null', tenantId=null, obTenantId=null, serverId=2, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=2, svrIp='10.79.169.38', deleted=false, createTime=null} 2024-12-31 18:30:51.081 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=35} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=2, svrIp='10.79.169.38', deleted=false, createTime=null} 2024-12-31 18:30:51.094 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=63} BaseTagEntity{id=null, clusterName='myoceanbase', clusterId=1, obClusterId=1735638920, zoneName='zone1', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=null, svrIp='null', deleted=false, createTime=null} 2024-12-31 18:30:51.097 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=6} BaseTagEntity{id=null, clusterName='myoceanbase', clusterId=1, obClusterId=1735638920, zoneName='zone3', tenantName='null', tenantId=null, obTenantId=null, serverId=2, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=2, svrIp='10.79.169.38', deleted=false, createTime=null} 2024-12-31 18:30:51.098 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=64} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=3, svrIp='10.79.169.36', deleted=false, createTime=null} 2024-12-31 18:30:51.101 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=48} BaseTagEntity{id=null, clusterName='myoceanbase', clusterId=1, obClusterId=1735638920, zoneName='zone2', tenantName='null', tenantId=null, obTenantId=null, serverId=3, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=3, svrIp='10.79.169.36', deleted=false, createTime=null} 2024-12-31 18:30:51.103 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=21} BaseTagEntity{id=null, clusterName='myoceanbase', clusterId=1, obClusterId=1735638920, zoneName='zone3', tenantName='null', tenantId=null, obTenantId=null, serverId=2, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=2, svrIp='10.79.169.38', deleted=false, createTime=null} 2024-12-31 18:30:51.105 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=33} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=3, svrIp='10.79.169.36', deleted=false, createTime=null} 2024-12-31 18:30:51.107 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=3} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=2, svrIp='10.79.169.38', deleted=false, createTime=null} 2024-12-31 18:30:51.109 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=47} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=3, svrIp='10.79.169.36', deleted=false, createTime=null} 2024-12-31 18:30:51.110 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=62} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=1, svrIp='10.79.169.37', deleted=false, createTime=null} 2024-12-31 18:30:51.112 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=10} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=1, svrIp='10.79.169.37', deleted=false, createTime=null} 2024-12-31 18:30:51.115 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=18} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=1, svrIp='10.79.169.37', deleted=false, createTime=null} 2024-12-31 18:30:51.117 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=12} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=2, svrIp='10.79.169.38', deleted=false, createTime=null} 2024-12-31 18:30:51.125 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=4} BaseTagEntity{id=null, clusterName='myoceanbase', clusterId=1, obClusterId=1735638920, zoneName='zone2', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=null, svrIp='null', deleted=false, createTime=null} 2024-12-31 18:30:51.130 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=36} BaseTagEntity{id=null, clusterName='myoceanbase', clusterId=1, obClusterId=1735638920, zoneName='zone3', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=null, svrIp='null', deleted=false, createTime=null} 2024-12-31 18:30:51.132 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=19} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=1, svrIp='10.79.169.37', deleted=false, createTime=null} 2024-12-31 18:30:51.135 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=61} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=1, svrIp='10.79.169.37', deleted=false, createTime=null} 2024-12-31 18:30:51.136 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=66} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=2, svrIp='10.79.169.38', deleted=false, createTime=null} 2024-12-31 18:30:51.138 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=56} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=2, svrIp='10.79.169.38', deleted=false, createTime=null} 2024-12-31 18:30:51.139 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=58} BaseTagEntity{id=null, clusterName='myoceanbase', clusterId=1, obClusterId=1735638920, zoneName='zone2', tenantName='null', tenantId=null, obTenantId=null, serverId=3, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=3, svrIp='10.79.169.36', deleted=false, createTime=null} 2024-12-31 18:30:51.141 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=27} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=3, svrIp='10.79.169.36', deleted=false, createTime=null} 2024-12-31 18:30:51.143 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=65} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=2, svrIp='10.79.169.38', deleted=false, createTime=null} 2024-12-31 18:30:51.145 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=24} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=1, svrIp='10.79.169.37', deleted=false, createTime=null} 2024-12-31 18:30:51.148 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=44} BaseTagEntity{id=null, clusterName='myoceanbase', clusterId=1, obClusterId=1735638920, zoneName='zone1', tenantName='null', tenantId=null, obTenantId=null, serverId=1, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=1, svrIp='10.79.169.37', deleted=false, createTime=null} 2024-12-31 18:30:51.149 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=50} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=3, svrIp='10.79.169.36', deleted=false, createTime=null} 2024-12-31 18:30:51.151 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=37} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=3, svrIp='10.79.169.36', deleted=false, createTime=null} 2024-12-31 18:30:51.153 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=51} BaseTagEntity{id=null, clusterName='myoceanbase', clusterId=1, obClusterId=1735638920, zoneName='zone1', tenantName='null', tenantId=null, obTenantId=null, serverId=1, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=1, svrIp='10.79.169.37', deleted=false, createTime=null} 2024-12-31 18:30:51.154 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=5} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=1, svrIp='10.79.169.37', deleted=false, createTime=null} 2024-12-31 18:30:51.156 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=16} BaseTagEntity{id=null, clusterName='myoceanbase', clusterId=1, obClusterId=1735638920, zoneName='zone1', tenantName='null', tenantId=null, obTenantId=null, serverId=1, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=1, svrIp='10.79.169.37', deleted=false, createTime=null} 2024-12-31 18:30:51.158 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=22} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=2, svrIp='10.79.169.38', deleted=false, createTime=null} 2024-12-31 18:30:51.159 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=57} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=2, svrIp='10.79.169.38', deleted=false, createTime=null} 2024-12-31 18:30:51.161 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=41} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=1, svrIp='10.79.169.37', deleted=false, createTime=null} 2024-12-31 18:30:51.163 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=38} BaseTagEntity{id=null, clusterName='null', clusterId=null, obClusterId=null, zoneName='null', tenantName='null', tenantId=null, obTenantId=null, serverId=null, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=3, svrIp='10.79.169.36', deleted=false, createTime=null} 2024-12-31 18:30:51.164 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save subtask tags, tag=SubtaskInstanceTagEntity{subtaskId=60} BaseTagEntity{id=null, clusterName='myoceanbase', clusterId=1, obClusterId=1735638920, zoneName='zone2', tenantName='null', tenantId=null, obTenantId=null, serverId=3, obproxyClusterName='null', obproxyClusterId=null, obproxyServerId=null, arbitrationServiceId=null, arbitrationServicePort=null, hostId=3, svrIp='10.79.169.36', deleted=false, createTime=null} 2024-12-31 18:30:51.168 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.task.TaskTagService : Save task tags, taskId=3, taskName=Take over primary OB cluster, argument=Argument{parallelIdx=-1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, ssh_port=22, prohibit_rollback=false, service_name=myoceanbase:1735638920, ob_connect_address=10.79.169.37:2883, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}} 2024-12-31 18:30:51.195 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.ocp.service.audit.AuditEventService : begin create audit event, param:CreateAuditEventParam(operationEvent=TAKE_OVER_OB_CLUSTER, eventType=OB_CLUSTER_MANAGEMENT, methodSignature=com.oceanbase.ocp.server.common.controller.ObClusterController.takeOverObCluster, resourceType=OB_CLUSTER, resources=[CreateAuditEventParam.AuditResourceParam(resourceId=null, resourceName=10.79.169.37:2883, parentResource=null)], operatorId=100, operatorName=admin, status=UNFINISHED, failedReason=null, taskId=3, eventInfo={"param":{"address":"10.79.169.37","clusterName":"myoceanbase","connectionMode":"proxy","hostInfo":{"credentialId":1,"hostTypeId":1,"kind":"DEDICATED_PHYSICAL_MACHINE","sshPort":22},"port":2883,"rootSysPassword":"******","saveToCredential":true,"switchConfigUrl":true}}, executionType=NEW, requestUrl=http://10.79.169.37:8090/api/v2/ob/clusters/takeOver, clientIp=10.108.139.108, serverIp=10.79.169.37, startTime=2024-12-31T18:30:48.537+08:00, endTime=null, role=null, aliUid=null) 2024-12-31 18:30:51.202 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,533c711d5df1d20e,15f057c7b2035949] c.o.o.s.c.trace.RequestTracingAspect : API OK: [POST /api/v2/ob/clusters/takeOver client=10.108.139.108, traceId=533c711d5df1d20e, duration=2684 ms] 2024-12-31 18:30:51.480 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,430444d223433a5d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 9, operation:EXECUTE, state: RUNNING 2024-12-31 18:30:51.498 INFO 34018 --- [manual-subtask-executor1,533c711d5df1d20e,f67872d0c4815c0b] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=9, context=Context{parallelIdx=-1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, ssh_port=22, service_name=myoceanbase:1735638920, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, latest_execution_start_time=2024-12-31T18:30:51.478+08:00, sub_task_instance_name=Prepare take over cluster, sub_task_instance_id=9}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:30:51.510 INFO 34018 --- [manual-subtask-executor1,533c711d5df1d20e,f67872d0c4815c0b] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 9, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:30:51.568 INFO 34018 --- [prometheus-minute-schedule-1,462abed42754e3f0,ad5ccd32ad2da595] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:51.676 INFO 34018 --- [ocp-updater-0,,] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh cluster [myoceanbase] cache 2024-12-31 18:30:51.677 INFO 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Get ob cluster myoceanbase cache info from db 2024-12-31 18:30:51.682 INFO 34018 --- [ocp-updater-0,,] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh cluster cache success 2024-12-31 18:30:51.689 INFO 34018 --- [ocp-updater-0,,] c.o.o.c.distributed.event.EventUpdater : [OCP116302] distributed event received by a9efd8d51e, eventId=1, event=RefreshClusterCacheEvent{name=refresh-config-server-cache, payload=["myoceanbase"]} 2024-12-31 18:30:51.704 INFO 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Get ob cluster myoceanbase cache info from db success. 2024-12-31 18:30:51.890 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:30:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:30:52.107 INFO 34018 --- [ocp-schedules-30,0191ab52feda33a2,534396d01f07a859] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:30:52.276 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:52.278 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:52.461 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.distributed.event.EventUpdater : [OCP116303] distributed event wait completed, eventId=1 2024-12-31 18:30:52.595 WARN 34018 --- [ocp-async-6,e0d9d67ff3b8a234,551ffbb1af50d09b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:52.602 INFO 34018 --- [ocp-async-1,58b9b0101e2c94b1,6281ca9e5d4e6dd6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:52.733 INFO 34018 --- [task-coordinator2,,] c.o.o.c.t.e.c.worker.AbstractTaskWorker : Set running subtask to ready, subtaskIds=[33, 3, 41] 2024-12-31 18:30:53.476 INFO 34018 --- [heartbeat-alarm-detect-by-target-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Slice modified, module=alarm-detect-by-target, name=10.79.169.37:8090, consumerId=1, resources=[ShardingSlice(consumerId=1, type=OBCluster, resourceIds=[1]), ShardingSlice(consumerId=1, type=Host, resourceIds=[1, 2, 3])] 2024-12-31 18:30:53.494 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,11aacfbf6f89e010] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 3, operation:EXECUTE, state: RUNNING 2024-12-31 18:30:53.502 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,11aacfbf6f89e010] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 33, operation:EXECUTE, state: RUNNING 2024-12-31 18:30:53.510 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,11aacfbf6f89e010] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 41, operation:EXECUTE, state: RUNNING 2024-12-31 18:30:53.513 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=3, context=Context{parallelIdx=1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:30:53.491+08:00, sub_task_instance_name=Pre check for create host, sub_task_instance_id=3}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:30:53.519 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=33, context=Context{parallelIdx=2, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:30:53.500+08:00, sub_task_instance_name=Pre check for create host, sub_task_instance_id=33}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:30:53.526 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=41, context=Context{parallelIdx=0, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:30:53.508+08:00, sub_task_instance_name=Pre check for create host, sub_task_instance_id=41}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:30:53.685 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:30:53.685 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:30:53.685 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:30:53.707 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.710 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] c.o.o.s.t.b.host.PreCreateHostCheckTask : Pre check for create host, ip=10.79.169.37 2024-12-31 18:30:53.717 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.719 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] c.o.o.s.t.b.host.PreCreateHostCheckTask : Pre check for create host, ip=10.79.169.36 2024-12-31 18:30:53.723 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.726 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] c.o.o.s.t.b.host.PreCreateHostCheckTask : Pre check for create host, ip=10.79.169.38 2024-12-31 18:30:53.746 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:30:53.756 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:30:53.762 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:30:53.771 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.783 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.792 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.810 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo '' on 10.79.169.37 2024-12-31 18:30:53.823 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo '' on 10.79.169.36 2024-12-31 18:30:53.831 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo '' on 10.79.169.38 2024-12-31 18:30:53.831 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo '' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo '', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.838 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] c.o.o.e.internal.template.SshTemplate : SSH execute end: echo '' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=echo '', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.841 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] c.o.o.s.t.b.host.PreCreateHostCheckTask : Check ssh console output, expected output is 'true', real output is 'true' 2024-12-31 18:30:53.844 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] c.o.o.executor.internal.util.PingUtils : Rtt by ssh, ip=10.79.169.37, port=22, loopCount=1, minSuccessCount=1 2024-12-31 18:30:53.852 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo '' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo '', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.855 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] c.o.o.e.internal.template.SshTemplate : SSH execute end: echo '' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=echo '', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.857 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] c.o.o.s.t.b.host.PreCreateHostCheckTask : Check ssh console output, expected output is 'true', real output is 'true' 2024-12-31 18:30:53.860 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo '' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo '', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.860 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] c.o.o.executor.internal.util.PingUtils : Rtt by ssh, ip=10.79.169.36, port=22, loopCount=1, minSuccessCount=1 2024-12-31 18:30:53.863 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] c.o.o.e.internal.template.SshTemplate : SSH execute end: echo '' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=echo '', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.869 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] c.o.o.s.t.b.host.PreCreateHostCheckTask : Check ssh console output, expected output is 'true', real output is 'true' 2024-12-31 18:30:53.870 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:30:53.871 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] c.o.o.executor.internal.util.PingUtils : Rtt by ssh, ip=10.79.169.38, port=22, loopCount=1, minSuccessCount=1 2024-12-31 18:30:53.891 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:30:53.894 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.899 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:30:53.916 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.928 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.933 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: whoami on 10.79.169.37 2024-12-31 18:30:53.953 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: whoami on 10.79.169.36 2024-12-31 18:30:53.956 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: whoami on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=whoami, out=admin, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.960 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] c.o.o.e.internal.template.SshTemplate : SSH execute end: whoami on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=whoami, out=admin, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.963 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] c.o.o.executor.internal.util.PingUtils : Rtt by ssh, rawList=[110] 2024-12-31 18:30:53.967 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] c.o.o.s.t.b.host.PreCreateHostCheckTask : Check ssh ping delay, delayMillis=110, maxAcceptableDelayMillis=3000 2024-12-31 18:30:53.967 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: whoami on 10.79.169.38 2024-12-31 18:30:53.973 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[10.79.169.37], timeoutMillis=20000 2024-12-31 18:30:53.980 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: whoami on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=whoami, out=admin, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.983 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] c.o.o.e.internal.template.SshTemplate : SSH execute end: whoami on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=whoami, out=admin, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:53.986 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] c.o.o.executor.internal.util.PingUtils : Rtt by ssh, rawList=[119] 2024-12-31 18:30:53.988 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] c.o.o.s.t.b.host.PreCreateHostCheckTask : Check ssh ping delay, delayMillis=119, maxAcceptableDelayMillis=3000 2024-12-31 18:30:53.991 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[10.79.169.36], timeoutMillis=20000 2024-12-31 18:30:53.999 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: whoami on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=whoami, out=admin, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:54.002 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] c.o.o.e.internal.template.SshTemplate : SSH execute end: whoami on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=whoami, out=admin, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:54.005 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] c.o.o.executor.internal.util.PingUtils : Rtt by ssh, rawList=[128] 2024-12-31 18:30:54.007 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] c.o.o.s.t.b.host.PreCreateHostCheckTask : Check ssh ping delay, delayMillis=128, maxAcceptableDelayMillis=3000 2024-12-31 18:30:54.010 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, executable=clockdiff, args=[10.79.169.38], timeoutMillis=20000 2024-12-31 18:30:54.033 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1735641054 -1 -1 , error= 2024-12-31 18:30:54.033 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1735641054 0 0 , error= 2024-12-31 18:30:54.034 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] c.o.ocp.core.util.LocalCommandExecutor : Execute local command, exitCode=0, out=1735641054 0 0 , error= 2024-12-31 18:30:54.038 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] c.o.o.s.t.b.host.PreCreateHostCheckTask : Check clock diff by ssh, clockDiff=-1, maxDiff=50 2024-12-31 18:30:54.041 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] c.o.o.s.t.b.host.PreCreateHostCheckTask : Check clock diff by ssh, clockDiff=0, maxDiff=50 2024-12-31 18:30:54.044 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] c.o.o.s.t.b.host.PreCreateHostCheckTask : Check clock diff by ssh, clockDiff=0, maxDiff=50 2024-12-31 18:30:54.053 INFO 34018 --- [manual-subtask-executor3,533c711d5df1d20e,5833cbebda7d4a82] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 33, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:30:54.056 INFO 34018 --- [manual-subtask-executor4,533c711d5df1d20e,64b94324c4a71b2c] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 41, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:30:54.058 INFO 34018 --- [manual-subtask-executor2,533c711d5df1d20e,9d711624520703ce] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 3, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:30:54.568 INFO 34018 --- [prometheus-minute-schedule-1,6566419f2e75b238,e3e3552fe19e12e8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:54.595 WARN 34018 --- [ocp-async-7,e4b55cff25c84f1a,8f44515db8984d6d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:54.602 INFO 34018 --- [ocp-async-9,fe2d34db270a186c,94572e22294dc26f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:55.187 INFO 34018 --- [task-coordinator2,,] c.o.o.c.t.e.c.worker.AbstractTaskWorker : Set running subtask to ready, subtaskIds=[69] 2024-12-31 18:30:55.240 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,4fdfe55a4e5f4922,2310101896857436] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/profiles/me?null, client=10.108.139.108, traceId=4fdfe55a4e5f4922, method=SuccessResponse com.oceanbase.ocp.server.common.controller.ProfileController.userInfo(), args=] 2024-12-31 18:30:55.241 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,dfdfc2e6e0e40619,787d979ebb15b6dc] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/config/systemInfo?null, client=10.108.139.108, traceId=dfdfc2e6e0e40619, method=SuccessResponse com.oceanbase.ocp.server.common.controller.PropertyController.getSystemInfo(), args=] 2024-12-31 18:30:55.241 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,dfdfc2e6e0e40619,787d979ebb15b6dc] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/config/systemInfo client=10.108.139.108, traceId=dfdfc2e6e0e40619, duration=4 ms] 2024-12-31 18:30:55.242 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,93ea2a5c3f4be1ee,f3282ae69341d683] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/state-statistics?null, client=10.108.139.108, traceId=93ea2a5c3f4be1ee, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskStateSummary(TaskType), args=MANUAL,] 2024-12-31 18:30:55.244 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,93ea2a5c3f4be1ee,f3282ae69341d683] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/state-statistics client=10.108.139.108, traceId=93ea2a5c3f4be1ee, duration=6 ms] 2024-12-31 18:30:55.246 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,4fdfe55a4e5f4922,2310101896857436] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/profiles/me client=10.108.139.108, traceId=4fdfe55a4e5f4922, duration=12 ms] 2024-12-31 18:30:55.246 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,69fc946fd299de4e,7e4661190f780cf3] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/alarm/alarms/actived?null, client=10.108.139.108, traceId=69fc946fd299de4e, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.AlarmController.fetchActivedAlarms(String,String,List,String,List,List,List,OffsetDateTime,OffsetDateTime,String,Pageable), args=Page request [number: 0, size 10, sort: id: DESC],] 2024-12-31 18:30:55.278 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:55.280 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:55.471 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,69fc946fd299de4e,7e4661190f780cf3] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/alarms/actived client=10.108.139.108, traceId=69fc946fd299de4e, duration=232 ms] 2024-12-31 18:30:55.523 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,413994f3c12990b7] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 69, operation:EXECUTE, state: RUNNING 2024-12-31 18:30:55.540 INFO 34018 --- [manual-subtask-executor5,533c711d5df1d20e,b751b7e5e7f2372f] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=69, context=Context{parallelIdx=-1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:30:55.521+08:00, sub_task_instance_name=Wait node, sub_task_instance_id=69}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:30:55.560 INFO 34018 --- [manual-subtask-executor5,533c711d5df1d20e,b751b7e5e7f2372f] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 69, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:30:55.640 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,55e643f6967b61a3,ee648ef667779710] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/telemetry?null, client=10.108.139.108, traceId=55e643f6967b61a3, method=SuccessResponse com.oceanbase.ocp.controller.TelemetryController.get(), args=] 2024-12-31 18:30:55.656 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,55e643f6967b61a3,ee648ef667779710] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/telemetry client=10.108.139.108, traceId=55e643f6967b61a3, duration=22 ms] 2024-12-31 18:30:56.409 INFO 34018 --- [task-coordinator2,,] c.o.o.c.t.e.c.worker.AbstractTaskWorker : Set running subtask to ready, subtaskIds=[50, 35, 62] 2024-12-31 18:30:56.533 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,3b778e47023ca6ef] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 35, operation:EXECUTE, state: RUNNING 2024-12-31 18:30:56.542 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,3b778e47023ca6ef] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 50, operation:EXECUTE, state: RUNNING 2024-12-31 18:30:56.548 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,dc2d376f13785d90,800ffb66c56692b8] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/3?taskInstanceId=3, client=10.108.139.108, traceId=dc2d376f13785d90, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=3,] 2024-12-31 18:30:56.549 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,3b778e47023ca6ef] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 62, operation:EXECUTE, state: RUNNING 2024-12-31 18:30:56.549 INFO 34018 --- [manual-subtask-executor6,533c711d5df1d20e,7a07bfe4c96704ec] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=35, context=Context{parallelIdx=1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:30:56.531+08:00, sub_task_instance_name=Update host arch info, sub_task_instance_id=35}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:30:56.552 INFO 34018 --- [manual-subtask-executor6,533c711d5df1d20e,7a07bfe4c96704ec] c.o.o.s.t.b.h.UpdateHostSystemInfoTask : Begin to update host arch info 2024-12-31 18:30:56.555 INFO 34018 --- [manual-subtask-executor7,533c711d5df1d20e,8dc5ca7b4cf6f5a7] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=50, context=Context{parallelIdx=2, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:30:56.539+08:00, sub_task_instance_name=Update host arch info, sub_task_instance_id=50}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:30:56.558 INFO 34018 --- [manual-subtask-executor7,533c711d5df1d20e,8dc5ca7b4cf6f5a7] c.o.o.s.t.b.h.UpdateHostSystemInfoTask : Begin to update host arch info 2024-12-31 18:30:56.562 INFO 34018 --- [manual-subtask-executor8,533c711d5df1d20e,ac22a7cd606a9a85] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=62, context=Context{parallelIdx=0, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:30:56.547+08:00, sub_task_instance_name=Update host arch info, sub_task_instance_id=62}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:30:56.564 INFO 34018 --- [manual-subtask-executor8,533c711d5df1d20e,ac22a7cd606a9a85] c.o.o.s.t.b.h.UpdateHostSystemInfoTask : Begin to update host arch info 2024-12-31 18:30:56.578 INFO 34018 --- [manual-subtask-executor6,533c711d5df1d20e,7a07bfe4c96704ec] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:30:56.579 INFO 34018 --- [manual-subtask-executor7,533c711d5df1d20e,8dc5ca7b4cf6f5a7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:30:56.584 INFO 34018 --- [manual-subtask-executor8,533c711d5df1d20e,ac22a7cd606a9a85] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:30:56.595 WARN 34018 --- [ocp-async-4,955ccbe735612feb,203aef0c941629e7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:56.602 INFO 34018 --- [ocp-async-5,511820ff8507f2c3,07fc7184fd6963ec] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:56.605 INFO 34018 --- [manual-subtask-executor7,533c711d5df1d20e,8dc5ca7b4cf6f5a7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:56.606 INFO 34018 --- [manual-subtask-executor8,533c711d5df1d20e,ac22a7cd606a9a85] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:56.608 INFO 34018 --- [manual-subtask-executor6,533c711d5df1d20e,7a07bfe4c96704ec] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:56.616 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,dc2d376f13785d90,800ffb66c56692b8] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/3 client=10.108.139.108, traceId=dc2d376f13785d90, duration=85 ms] 2024-12-31 18:30:56.629 INFO 34018 --- [heartbeat-metric-collect-10.79.169.37:80901,,] c.o.o.c.s.registry.ConsumerRegistry : Slice modified, module=metric-collect, name=10.79.169.37:8090, consumerId=3, resources=[ShardingSlice(consumerId=3, type=OB_CLUSTER, resourceIds=[1]), ShardingSlice(consumerId=3, type=HOST_MONITOR, resourceIds=[1, 2, 3])] 2024-12-31 18:30:56.644 INFO 34018 --- [manual-subtask-executor7,533c711d5df1d20e,8dc5ca7b4cf6f5a7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:30:56.645 INFO 34018 --- [manual-subtask-executor8,533c711d5df1d20e,ac22a7cd606a9a85] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:30:56.647 INFO 34018 --- [manual-subtask-executor6,533c711d5df1d20e,7a07bfe4c96704ec] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:30:56.666 INFO 34018 --- [manual-subtask-executor8,533c711d5df1d20e,ac22a7cd606a9a85] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:56.669 INFO 34018 --- [manual-subtask-executor7,533c711d5df1d20e,8dc5ca7b4cf6f5a7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:56.678 INFO 34018 --- [manual-subtask-executor6,533c711d5df1d20e,7a07bfe4c96704ec] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:56.705 INFO 34018 --- [manual-subtask-executor8,533c711d5df1d20e,ac22a7cd606a9a85] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... uname_ext on 10.79.169.37 2024-12-31 18:30:56.709 INFO 34018 --- [manual-subtask-executor7,533c711d5df1d20e,8dc5ca7b4cf6f5a7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... uname_ext on 10.79.169.36 2024-12-31 18:30:56.717 INFO 34018 --- [manual-subtask-executor6,533c711d5df1d20e,7a07bfe4c96704ec] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... uname_ext on 10.79.169.38 2024-12-31 18:30:56.741 INFO 34018 --- [manual-subtask-executor8,533c711d5df1d20e,ac22a7cd606a9a85] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... uname_ext on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=#!/bin/bash ... uname_ext, out={"sysname": "Linux", "nodename": "czbd.hdnode2", "release": "3.10.0-957.el7.x86_64", "version": "#1 SMP Thu Nov 8 23:39:32 UTC 2018", "machine": "x86_64", "processor": "x86_64", "is_in_docker": false, "linux_distribution_name": "centos", "linux_distribution_release": "7"}, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:56.744 INFO 34018 --- [manual-subtask-executor8,533c711d5df1d20e,ac22a7cd606a9a85] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... uname_ext on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=#!/bin/bash ... uname_ext, out={"sysname": "Linux", "nodename": "czbd.hdnode2", "release": "3.10.0-957.el7.x86_64", "version": "#1 SMP Thu Nov 8 23:39:32 UTC 2018", "machine": "x86_64", "processor": "x86_64", "is_in_docker": false, "linux_distribution_name": "centos", "linux_distribution_release": "7"}, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:56.749 INFO 34018 --- [manual-subtask-executor7,533c711d5df1d20e,8dc5ca7b4cf6f5a7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... uname_ext on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=#!/bin/bash ... uname_ext, out={"sysname": "Linux", "nodename": "czbd.hdnode1", "release": "3.10.0-957.el7.x86_64", "version": "#1 SMP Thu Nov 8 23:39:32 UTC 2018", "machine": "x86_64", "processor": "x86_64", "is_in_docker": false, "linux_distribution_name": "centos", "linux_distribution_release": "7"}, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:56.752 INFO 34018 --- [manual-subtask-executor7,533c711d5df1d20e,8dc5ca7b4cf6f5a7] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... uname_ext on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=#!/bin/bash ... uname_ext, out={"sysname": "Linux", "nodename": "czbd.hdnode1", "release": "3.10.0-957.el7.x86_64", "version": "#1 SMP Thu Nov 8 23:39:32 UTC 2018", "machine": "x86_64", "processor": "x86_64", "is_in_docker": false, "linux_distribution_name": "centos", "linux_distribution_release": "7"}, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:56.773 INFO 34018 --- [manual-subtask-executor6,533c711d5df1d20e,7a07bfe4c96704ec] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... uname_ext on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=#!/bin/bash ... uname_ext, out={"sysname": "Linux", "nodename": "node1", "release": "3.10.0-957.el7.x86_64", "version": "#1 SMP Thu Nov 8 23:39:32 UTC 2018", "machine": "x86_64", "processor": "x86_64", "is_in_docker": false, "linux_distribution_name": "centos", "linux_distribution_release": "7"}, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:56.776 INFO 34018 --- [manual-subtask-executor6,533c711d5df1d20e,7a07bfe4c96704ec] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... uname_ext on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=#!/bin/bash ... uname_ext, out={"sysname": "Linux", "nodename": "node1", "release": "3.10.0-957.el7.x86_64", "version": "#1 SMP Thu Nov 8 23:39:32 UTC 2018", "machine": "x86_64", "processor": "x86_64", "is_in_docker": false, "linux_distribution_name": "centos", "linux_distribution_release": "7"}, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:56.840 INFO 34018 --- [manual-subtask-executor7,533c711d5df1d20e,8dc5ca7b4cf6f5a7] c.o.o.s.t.b.h.UpdateHostSystemInfoTask : Success to update host arch info 2024-12-31 18:30:56.840 INFO 34018 --- [manual-subtask-executor8,533c711d5df1d20e,ac22a7cd606a9a85] c.o.o.s.t.b.h.UpdateHostSystemInfoTask : Success to update host arch info 2024-12-31 18:30:56.841 INFO 34018 --- [manual-subtask-executor6,533c711d5df1d20e,7a07bfe4c96704ec] c.o.o.s.t.b.h.UpdateHostSystemInfoTask : Success to update host arch info 2024-12-31 18:30:56.847 INFO 34018 --- [manual-subtask-executor7,533c711d5df1d20e,8dc5ca7b4cf6f5a7] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 50, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:30:56.849 INFO 34018 --- [manual-subtask-executor8,533c711d5df1d20e,ac22a7cd606a9a85] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 62, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:30:56.851 INFO 34018 --- [manual-subtask-executor6,533c711d5df1d20e,7a07bfe4c96704ec] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 35, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:30:57.214 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,6f568befd44adc92,e0e871129828878d] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/info?null, client=10.108.139.108, traceId=6f568befd44adc92, method=OcpBuildInfo com.oceanbase.ocp.server.common.controller.InfoController.info(), args=] 2024-12-31 18:30:57.214 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,08cbe652d88d3103,3802d9bdd601dcb9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/sensitiveDataKey?null, client=10.108.139.108, traceId=08cbe652d88d3103, method=SuccessResponse com.oceanbase.ocp.server.common.controller.InfoController.getSensitiveDataPublicKey(), args=] 2024-12-31 18:30:57.214 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,6f568befd44adc92,e0e871129828878d] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/info client=10.108.139.108, traceId=6f568befd44adc92, duration=4 ms] 2024-12-31 18:30:57.214 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,08cbe652d88d3103,3802d9bdd601dcb9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/sensitiveDataKey client=10.108.139.108, traceId=08cbe652d88d3103, duration=5 ms] 2024-12-31 18:30:57.217 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,8b14bcd246435d76,e9c4ba8f775510c5] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/time?null, client=10.108.139.108, traceId=8b14bcd246435d76, method=OffsetDateTime com.oceanbase.ocp.server.common.controller.InfoController.time(), args=] 2024-12-31 18:30:57.218 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,8b14bcd246435d76,e9c4ba8f775510c5] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/time client=10.108.139.108, traceId=8b14bcd246435d76, duration=5 ms] 2024-12-31 18:30:57.375 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=10.108.139.108, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2024-12-31 18:30:57.375 WARN 34018 --- [http-nio-0.0.0.0-8090-exec-10,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/maz/state, method=10.108.139.108, client=GET, traceId=] 2024-12-31 18:30:57.375 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=10.108.139.108, traceId=, duration=0 ms] 2024-12-31 18:30:57.375 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=10.108.139.108, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2024-12-31 18:30:57.375 WARN 34018 --- [http-nio-0.0.0.0-8090-exec-5,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/mc/info, method=10.108.139.108, client=GET, traceId=] 2024-12-31 18:30:57.375 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=10.108.139.108, traceId=, duration=0 ms] 2024-12-31 18:30:57.568 INFO 34018 --- [prometheus-minute-schedule-1,a6fffec63cac1f2e,8180c8c637357ac1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641060, interval=60 2024-12-31 18:30:57.607 INFO 34018 --- [task-coordinator2,,] c.o.o.c.t.e.c.worker.AbstractTaskWorker : Set running subtask to ready, subtaskIds=[14] 2024-12-31 18:30:58.280 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:30:58.282 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:30:58.503 INFO 34018 --- [ocp-async-5,81dc7318b4c5c312,607e67d6fbfee266] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:30:58.525 INFO 34018 --- [ocp-schedules-2,9bc062fd7b5b0433,7e7e9938c997cec5] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:30:58.562 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,011a40b5b58d7dd4] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 14, operation:EXECUTE, state: RUNNING 2024-12-31 18:30:58.580 INFO 34018 --- [manual-subtask-executor9,533c711d5df1d20e,55f86ec90d5d0058] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=14, context=Context{parallelIdx=-1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:30:58.559+08:00, sub_task_instance_name=Wait node, sub_task_instance_id=14}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:30:58.588 INFO 34018 --- [manual-subtask-executor9,533c711d5df1d20e,55f86ec90d5d0058] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 14, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:30:58.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:30:58.588726+08:00, lastProcessTime=2024-12-31T18:30:48.587802+08:00 2024-12-31 18:30:58.595 WARN 34018 --- [ocp-async-6,6171210dbcf84860,f179ddfba250755d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:30:58.602 INFO 34018 --- [ocp-async-7,04abbd5f2ecf68bc,9e9224b13a64c393] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:30:58.768 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.a.c.d.MessageDistributorFactory : build alarmSubscribedJudger, currentSubscribedJudgerVersion subscription-0-2024-12-31T18:19:22.984+08:00_groups-11-2024-12-31T18:12:40+08:00-2024-12-31T18:12:40+08:00_detectRules-536-2024-12-31T10:12:44.838876Z_readableClusters_2_system-myoceanbase admin-myoceanbase, subscribedJudgerVersion subscription-0-2024-12-31T18:19:22.984+08:00_groups-11-2024-12-31T18:12:40+08:00-2024-12-31T18:12:40+08:00_detectRules-536-2024-12-31T10:12:44.838876Z_readableClusters_2_system- admin- 2024-12-31 18:30:58.768 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.a.c.distribute.DistributeBuilder : buildSubscribedJudger, usersSubscribedCount=0, userEnableReceiveCount=0 2024-12-31 18:30:58.768 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.a.c.d.MessageDistributorFactory : build recoverSubscribedJudger, currentSubscribedJudgerVersion subscription-0-2024-12-31T18:19:22.984+08:00_groups-11-2024-12-31T18:12:40+08:00-2024-12-31T18:12:40+08:00_detectRules-536-2024-12-31T10:12:44.838876Z_readableClusters_2_system-myoceanbase admin-myoceanbase, subscribedJudgerVersion subscription-0-2024-12-31T18:19:22.984+08:00_groups-11-2024-12-31T18:12:40+08:00-2024-12-31T18:12:40+08:00_detectRules-536-2024-12-31T10:12:44.838876Z_readableClusters_2_system- admin- 2024-12-31 18:30:58.768 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.a.c.distribute.DistributeBuilder : buildRecoverMessageSubscribedJudger, usersSubscribedCount=0, userEnableReceiveCount=0 2024-12-31 18:30:58.768 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.a.c.d.MessageDistributorFactory : buildAllDistributors 2024-12-31 18:30:58.771 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:30:58.588726+08:00 2024-12-31 18:30:58.816 INFO 34018 --- [task-coordinator2,,] c.o.o.c.t.e.c.worker.AbstractTaskWorker : Set running subtask to ready, subtaskIds=[18, 56, 27] 2024-12-31 18:30:59.580 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,f93d8065c306818d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 18, operation:EXECUTE, state: RUNNING 2024-12-31 18:30:59.591 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,f93d8065c306818d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 27, operation:EXECUTE, state: RUNNING 2024-12-31 18:30:59.601 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,f93d8065c306818d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 56, operation:EXECUTE, state: RUNNING 2024-12-31 18:30:59.603 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=18, context=Context{parallelIdx=0, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:30:59.576+08:00, sub_task_instance_name=Uninstall legacy obagent, sub_task_instance_id=18}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:30:59.608 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] c.o.o.s.t.b.o.UninstallLegacyObAgentTask : [UninstallLegacyObAgentTask] uninstall legacy obagent begin 2024-12-31 18:30:59.612 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=27, context=Context{parallelIdx=2, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:30:59.589+08:00, sub_task_instance_name=Uninstall legacy obagent, sub_task_instance_id=27}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:30:59.616 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] c.o.o.s.t.b.o.UninstallLegacyObAgentTask : [UninstallLegacyObAgentTask] uninstall legacy obagent begin 2024-12-31 18:30:59.617 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=56, context=Context{parallelIdx=1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:30:59.598+08:00, sub_task_instance_name=Uninstall legacy obagent, sub_task_instance_id=56}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:30:59.622 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] c.o.o.s.t.b.o.UninstallLegacyObAgentTask : [UninstallLegacyObAgentTask] uninstall legacy obagent begin 2024-12-31 18:30:59.640 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:30:59.642 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:30:59.643 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:30:59.662 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.670 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.680 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.701 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:30:59.708 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:30:59.719 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:30:59.724 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.733 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.749 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.762 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:30:59.772 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36 2024-12-31 18:30:59.788 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38 2024-12-31 18:30:59.834 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.837 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.845 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.848 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.870 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:30:59.884 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:30:59.893 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.898 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.901 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ob_agentd|obstat|ob_sql|ob_sql_audit|ob_logtailer|ob_cleaner|ob_exporter_1|ob_exporter_60|node_exporter_wrapper_ob|node_exporter_wrapper_obproxy' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.909 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:30:59.934 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package '^t-oceanbase-obagent' on 10.79.169.36 2024-12-31 18:30:59.938 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:30:59.948 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package '^t-oceanbase-obagent' on 10.79.169.37 2024-12-31 18:30:59.967 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:00.007 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package '^t-oceanbase-obagent' on 10.79.169.38 2024-12-31 18:31:00.517 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package '^t-oceanbase-obagent' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=#!/bin/bash ... find_package '^t-oceanbase-obagent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:00.520 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package '^t-oceanbase-obagent' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=#!/bin/bash ... find_package '^t-oceanbase-obagent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:00.522 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package '^t-oceanbase-obagent' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=#!/bin/bash ... find_package '^t-oceanbase-obagent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:00.523 WARN 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] c.o.ocp.executor.executor.SshExecutor : package name not found from host:^t-oceanbase-obagent 2024-12-31 18:31:00.525 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package '^t-oceanbase-obagent' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=#!/bin/bash ... find_package '^t-oceanbase-obagent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:00.528 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=^t-oceanbase-obagent 2024-12-31 18:31:00.530 WARN 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] c.o.ocp.executor.executor.SshExecutor : package name not found from host:^t-oceanbase-obagent 2024-12-31 18:31:00.535 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=^t-oceanbase-obagent 2024-12-31 18:31:00.557 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:00.562 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:00.568 INFO 34018 --- [prometheus-minute-schedule-1,d0a21fa293b5d474,82da11ff759df68a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:00.579 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:00.587 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:00.595 WARN 34018 --- [ocp-async-7,3dcf28ca803e4e9d,0b5bab406b7ff197] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:00.602 INFO 34018 --- [ocp-async-4,1d731faecd0410f0,5901b5331650dbbe] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:00.619 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package '^t-oceanbase-ob-agent' on 10.79.169.37 2024-12-31 18:31:00.628 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package '^t-oceanbase-ob-agent' on 10.79.169.36 2024-12-31 18:31:00.713 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package '^t-oceanbase-obagent' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=#!/bin/bash ... find_package '^t-oceanbase-obagent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:00.717 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package '^t-oceanbase-obagent' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=#!/bin/bash ... find_package '^t-oceanbase-obagent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:00.720 WARN 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] c.o.ocp.executor.executor.SshExecutor : package name not found from host:^t-oceanbase-obagent 2024-12-31 18:31:00.724 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=^t-oceanbase-obagent 2024-12-31 18:31:00.753 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:00.782 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:00.821 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package '^t-oceanbase-ob-agent' on 10.79.169.38 2024-12-31 18:31:01.205 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package '^t-oceanbase-ob-agent' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=#!/bin/bash ... find_package '^t-oceanbase-ob-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:01.208 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package '^t-oceanbase-ob-agent' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=#!/bin/bash ... find_package '^t-oceanbase-ob-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:01.211 WARN 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] c.o.ocp.executor.executor.SshExecutor : package name not found from host:^t-oceanbase-ob-agent 2024-12-31 18:31:01.213 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=^t-oceanbase-ob-agent 2024-12-31 18:31:01.215 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] c.o.o.s.t.b.o.UninstallLegacyObAgentTask : [UninstallLegacyObAgentTask] uninstall legacy obagent success 2024-12-31 18:31:01.222 INFO 34018 --- [manual-subtask-executor10,533c711d5df1d20e,7ee758dcd244db11] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 18, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:31:01.225 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package '^t-oceanbase-ob-agent' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=#!/bin/bash ... find_package '^t-oceanbase-ob-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:01.228 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package '^t-oceanbase-ob-agent' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=#!/bin/bash ... find_package '^t-oceanbase-ob-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:01.230 WARN 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] c.o.ocp.executor.executor.SshExecutor : package name not found from host:^t-oceanbase-ob-agent 2024-12-31 18:31:01.232 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=^t-oceanbase-ob-agent 2024-12-31 18:31:01.234 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] c.o.o.s.t.b.o.UninstallLegacyObAgentTask : [UninstallLegacyObAgentTask] uninstall legacy obagent success 2024-12-31 18:31:01.241 INFO 34018 --- [manual-subtask-executor11,533c711d5df1d20e,dd1cb77a8c276fd7] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 27, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:31:01.282 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:01.284 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:01.447 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package '^t-oceanbase-ob-agent' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=#!/bin/bash ... find_package '^t-oceanbase-ob-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:01.451 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package '^t-oceanbase-ob-agent' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=#!/bin/bash ... find_package '^t-oceanbase-ob-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:01.454 WARN 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] c.o.ocp.executor.executor.SshExecutor : package name not found from host:^t-oceanbase-ob-agent 2024-12-31 18:31:01.457 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=^t-oceanbase-ob-agent 2024-12-31 18:31:01.460 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] c.o.o.s.t.b.o.UninstallLegacyObAgentTask : [UninstallLegacyObAgentTask] uninstall legacy obagent success 2024-12-31 18:31:01.469 INFO 34018 --- [manual-subtask-executor12,533c711d5df1d20e,7493e01d5420bd75] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 56, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:31:02.176 INFO 34018 --- [ocp-schedules-21,53955c9ef76b6709,58a3f8b6c2c30c06] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:31:02.427 INFO 34018 --- [task-coordinator2,,] c.o.o.c.t.e.c.worker.AbstractTaskWorker : Set running subtask to ready, subtaskIds=[54] 2024-12-31 18:31:02.596 WARN 34018 --- [ocp-async-4,66f41213e0bcae48,27c2a8c31b23b9b0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:02.603 INFO 34018 --- [ocp-async-10,0487824013d54d7a,5749970b44a199f9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:02.619 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,47f7f56f9809dc35] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 54, operation:EXECUTE, state: RUNNING 2024-12-31 18:31:02.637 INFO 34018 --- [manual-subtask-executor13,533c711d5df1d20e,ad0c7a22f6bb763d] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=54, context=Context{parallelIdx=-1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:31:02.616+08:00, sub_task_instance_name=Wait node, sub_task_instance_id=54}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:31:02.647 INFO 34018 --- [manual-subtask-executor13,533c711d5df1d20e,ad0c7a22f6bb763d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 54, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:31:03.568 INFO 34018 --- [prometheus-minute-schedule-1,87ba3707c8891ca3,8fb36734ee47cf59] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:03.664 INFO 34018 --- [task-coordinator2,,] c.o.o.c.t.e.c.worker.AbstractTaskWorker : Set running subtask to ready, subtaskIds=[24, 12, 47] 2024-12-31 18:31:04.284 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:04.286 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:04.596 WARN 34018 --- [ocp-async-10,d90d8498f34879f9,919b885f0adfa7fc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:04.603 INFO 34018 --- [ocp-async-8,ab6a92ae3b6b4cea,efe4e902316f4ed5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:04.636 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,f379b7ac881d3b7d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 12, operation:EXECUTE, state: RUNNING 2024-12-31 18:31:04.645 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,f379b7ac881d3b7d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 24, operation:EXECUTE, state: RUNNING 2024-12-31 18:31:04.654 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,f379b7ac881d3b7d] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 47, operation:EXECUTE, state: RUNNING 2024-12-31 18:31:04.653 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=12, context=Context{parallelIdx=1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:31:04.633+08:00, sub_task_instance_name=Uninstall legacy ocp agent, sub_task_instance_id=12}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:31:04.657 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] .o.o.s.t.b.h.UninstallLegacyOcpAgentTask : [UninstallLegacyOcpAgentTask] start legacy ocp agent uninstallation 2024-12-31 18:31:04.661 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=24, context=Context{parallelIdx=0, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:31:04.642+08:00, sub_task_instance_name=Uninstall legacy ocp agent, sub_task_instance_id=24}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:31:04.664 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] .o.o.s.t.b.h.UninstallLegacyOcpAgentTask : [UninstallLegacyOcpAgentTask] start legacy ocp agent uninstallation 2024-12-31 18:31:04.668 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=47, context=Context{parallelIdx=2, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:31:04.651+08:00, sub_task_instance_name=Uninstall legacy ocp agent, sub_task_instance_id=47}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:31:04.671 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] .o.o.s.t.b.h.UninstallLegacyOcpAgentTask : [UninstallLegacyOcpAgentTask] start legacy ocp agent uninstallation 2024-12-31 18:31:04.679 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:04.686 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:04.692 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:04.710 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.711 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.719 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.749 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:04.750 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:04.760 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:04.772 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.781 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.785 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.811 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:31:04.821 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38 2024-12-31 18:31:04.825 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36 2024-12-31 18:31:04.876 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.880 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.884 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.887 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.905 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.909 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'supervisord' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.916 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:04.924 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:04.938 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.945 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:04.948 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.973 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:04.977 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:31:04.988 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36 2024-12-31 18:31:05.013 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38 2024-12-31 18:31:05.037 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.040 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.049 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.052 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.076 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:05.088 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:05.091 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.094 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.099 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.112 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.131 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:05.138 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:31:05.152 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36 2024-12-31 18:31:05.160 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.200 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38 2024-12-31 18:31:05.210 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.212 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.213 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.216 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.249 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:05.252 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:05.270 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.277 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.277 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.283 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'pos_proxy' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.310 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:31:05.317 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:05.318 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36 2024-12-31 18:31:05.347 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.375 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.376 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.378 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.381 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.386 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38 2024-12-31 18:31:05.415 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:05.416 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:05.438 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.441 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.461 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.464 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.479 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:31:05.481 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36 2024-12-31 18:31:05.501 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:05.530 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.540 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.545 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.546 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.550 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'node_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.570 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38 2024-12-31 18:31:05.580 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:05.585 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:05.603 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.608 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.643 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36 2024-12-31 18:31:05.648 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo bash -c 'pgrep '"'"'node_exporter'"'"' | xargs --no-run-if-empty kill -9' on 10.79.169.37 2024-12-31 18:31:05.649 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.654 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.689 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:05.697 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.700 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.718 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.737 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:05.752 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo bash -c 'pgrep '"'"'node_exporter'"'"' | xargs --no-run-if-empty kill -9' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=sudo bash -c 'pgrep '"'"'node_exporter'"'"' | xargs --no-run-if-empty kill -9', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.755 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo bash -c 'pgrep '"'"'node_exporter'"'"' | xargs --no-run-if-empty kill -9' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=sudo bash -c 'pgrep '"'"'node_exporter'"'"' | xargs --no-run-if-empty kill -9', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.758 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38 2024-12-31 18:31:05.761 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.791 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:05.801 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36 2024-12-31 18:31:05.812 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.838 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.841 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.851 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:31:05.863 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.866 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.877 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:05.904 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:05.906 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.917 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.920 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'obstat' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.930 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:05.946 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38 2024-12-31 18:31:05.956 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:05.969 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36 2024-12-31 18:31:05.976 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.016 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:31:06.028 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.030 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.031 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.034 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.067 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:06.070 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:06.079 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.082 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'obstat2' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.092 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.095 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.118 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:06.132 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36 2024-12-31 18:31:06.135 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38 2024-12-31 18:31:06.143 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.183 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:31:06.190 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.194 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.214 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.217 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.230 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:06.248 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.251 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ob_logtailer' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.253 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:06.253 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.283 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.287 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:06.293 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.36 2024-12-31 18:31:06.312 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.322 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38 2024-12-31 18:31:06.352 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:31:06.397 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.401 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.423 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.427 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ob_cleaner' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.437 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:06.463 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:06.466 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.489 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.507 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.38 2024-12-31 18:31:06.529 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:31:06.568 INFO 34018 --- [prometheus-minute-schedule-1,066328b5df56c62d,b9b02c1bb84acd04] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:06.596 WARN 34018 --- [ocp-async-7,302054900ffdba3b,af962a33e62fc43d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:06.603 INFO 34018 --- [ocp-async-3,0aab8ae35c191fa3,5a69b1fc6dbaeb2d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:06.601 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.604 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ocp_exporter' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.641 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:06.662 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.701 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.37 2024-12-31 18:31:06.880 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=#!/bin/bash ... find_package 't-oceanbase-ocp-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.884 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=#!/bin/bash ... find_package 't-oceanbase-ocp-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.887 WARN 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.ocp.executor.executor.SshExecutor : package name not found from host:t-oceanbase-ocp-agent 2024-12-31 18:31:06.890 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=t-oceanbase-ocp-agent 2024-12-31 18:31:06.919 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:06.946 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:06.986 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36 2024-12-31 18:31:07.049 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.053 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.089 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:07.116 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.156 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36 2024-12-31 18:31:07.220 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.223 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.249 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=#!/bin/bash ... find_package 't-oceanbase-ocp-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.252 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=#!/bin/bash ... find_package 't-oceanbase-ocp-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.255 WARN 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.ocp.executor.executor.SshExecutor : package name not found from host:t-oceanbase-ocp-agent 2024-12-31 18:31:07.258 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=t-oceanbase-ocp-agent 2024-12-31 18:31:07.261 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:07.286 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:07.284 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.287 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:07.289 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:07.317 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.324 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36 2024-12-31 18:31:07.329 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=#!/bin/bash ... find_package 't-oceanbase-ocp-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.332 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=#!/bin/bash ... find_package 't-oceanbase-ocp-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.335 WARN 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.ocp.executor.executor.SshExecutor : package name not found from host:t-oceanbase-ocp-agent 2024-12-31 18:31:07.337 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=t-oceanbase-ocp-agent 2024-12-31 18:31:07.357 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38 2024-12-31 18:31:07.369 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:07.382 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.386 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=(pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.389 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.s.c.AgentInstallationTaskService : Uninstall compatibility history ocp-agent, rpmName=t-oceanbase-ocp-agent 2024-12-31 18:31:07.392 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.422 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:07.431 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:31:07.440 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.443 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.446 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.479 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:07.486 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.36 2024-12-31 18:31:07.505 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.509 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ocp_agentd' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.509 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.545 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:07.549 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38 2024-12-31 18:31:07.568 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.608 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:31:07.629 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.632 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.669 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:07.682 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.686 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ocp_mgragent' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.696 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.722 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:07.736 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38 2024-12-31 18:31:07.746 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.786 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: (pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37 2024-12-31 18:31:07.820 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.823 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=(pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.826 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.s.c.AgentInstallationTaskService : Uninstall compatibility history ocp-agent, rpmName=t-oceanbase-ocp-agent 2024-12-31 18:31:07.856 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: (pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.859 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: (pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=(pgrep -af 'ocp_monagent' | grep -cv pgrep | xargs --no-run-if-empty) || true, out=0, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.860 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:07.863 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.s.c.AgentInstallationTaskService : Uninstall compatibility history ocp-agent, rpmName=t-oceanbase-ocp-agent 2024-12-31 18:31:07.891 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.896 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:07.919 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:07.931 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.38 2024-12-31 18:31:07.959 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.37 2024-12-31 18:31:08.083 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=#!/bin/bash ... find_package 't-oceanbase-ocp-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.087 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=#!/bin/bash ... find_package 't-oceanbase-ocp-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.089 WARN 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.ocp.executor.executor.SshExecutor : package name not found from host:t-oceanbase-ocp-agent 2024-12-31 18:31:08.092 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=t-oceanbase-ocp-agent 2024-12-31 18:31:08.095 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.s.c.AgentInstallationTaskService : Uninstall ocp-agent, rpmName=ocp-agent-ce 2024-12-31 18:31:08.123 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:08.146 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.186 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package 'ocp-agent-ce' on 10.79.169.36 2024-12-31 18:31:08.504 INFO 34018 --- [ocp-async-3,e25d0f5dc52370c8,a6a5c835bb423c63] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:31:08.527 INFO 34018 --- [ocp-schedules-7,7c5f89574c4e12d3,addc8bad080a6924] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:31:08.534 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=#!/bin/bash ... find_package 't-oceanbase-ocp-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.537 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=#!/bin/bash ... find_package 't-oceanbase-ocp-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.540 WARN 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.ocp.executor.executor.SshExecutor : package name not found from host:t-oceanbase-ocp-agent 2024-12-31 18:31:08.542 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=t-oceanbase-ocp-agent 2024-12-31 18:31:08.546 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.s.c.AgentInstallationTaskService : Uninstall ocp-agent, rpmName=ocp-agent-ce 2024-12-31 18:31:08.567 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=#!/bin/bash ... find_package 't-oceanbase-ocp-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.570 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package 't-oceanbase-ocp-agent' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=#!/bin/bash ... find_package 't-oceanbase-ocp-agent', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.573 WARN 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.ocp.executor.executor.SshExecutor : package name not found from host:t-oceanbase-ocp-agent 2024-12-31 18:31:08.574 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:08.575 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=t-oceanbase-ocp-agent 2024-12-31 18:31:08.580 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.s.c.AgentInstallationTaskService : Uninstall ocp-agent, rpmName=ocp-agent-ce 2024-12-31 18:31:08.588 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:31:08.586984+08:00, lastProcessTime=2024-12-31T18:30:58.588726+08:00 2024-12-31 18:31:08.596 WARN 34018 --- [ocp-async-4,59ca5a2f4d3c27ae,71ae9c4442ad8afc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:08.603 INFO 34018 --- [ocp-async-5,3d640ad848cac08f,b166ed3521325d1f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:08.603 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.607 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:08.629 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.643 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package 'ocp-agent-ce' on 10.79.169.38 2024-12-31 18:31:08.668 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: #!/bin/bash ... find_package 'ocp-agent-ce' on 10.79.169.37 2024-12-31 18:31:08.732 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:31:08.586984+08:00 2024-12-31 18:31:08.776 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package 'ocp-agent-ce' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=#!/bin/bash ... find_package 'ocp-agent-ce', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.780 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package 'ocp-agent-ce' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=#!/bin/bash ... find_package 'ocp-agent-ce', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.783 WARN 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.ocp.executor.executor.SshExecutor : package name not found from host:ocp-agent-ce 2024-12-31 18:31:08.785 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=ocp-agent-ce 2024-12-31 18:31:08.816 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:08.837 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.877 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'' on 10.79.169.36 2024-12-31 18:31:08.921 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.925 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:08.928 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] .o.o.s.t.b.h.UninstallLegacyOcpAgentTask : [UninstallLegacyOcpAgentTask] legacy ocp agent uninstallation succeeded 2024-12-31 18:31:08.936 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,9d206286744fa039] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 47, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:31:09.242 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package 'ocp-agent-ce' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=#!/bin/bash ... find_package 'ocp-agent-ce', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:09.245 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package 'ocp-agent-ce' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=#!/bin/bash ... find_package 'ocp-agent-ce', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:09.248 WARN 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.ocp.executor.executor.SshExecutor : package name not found from host:ocp-agent-ce 2024-12-31 18:31:09.251 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=ocp-agent-ce 2024-12-31 18:31:09.283 INFO 34018 --- [ocp-schedules-18,2f3da8f6d8d1a110,35170ae3032bace6] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:31:09.282 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:09.292 INFO 34018 --- [ocp-schedules-18,2f3da8f6d8d1a110,35170ae3032bace6] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:31:09.292 INFO 34018 --- [ocp-schedules-18,2f3da8f6d8d1a110,35170ae3032bace6] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:31:09.308 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:09.348 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'' on 10.79.169.37 2024-12-31 18:31:09.372 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: #!/bin/bash ... find_package 'ocp-agent-ce' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=#!/bin/bash ... find_package 'ocp-agent-ce', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:09.376 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: #!/bin/bash ... find_package 'ocp-agent-ce' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=#!/bin/bash ... find_package 'ocp-agent-ce', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:09.379 WARN 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.ocp.executor.executor.SshExecutor : package name not found from host:ocp-agent-ce 2024-12-31 18:31:09.382 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.ocp.executor.executor.SshExecutor : uninstall skipped. No package found. rpmName=ocp-agent-ce 2024-12-31 18:31:09.407 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:09.410 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:09.413 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] .o.o.s.t.b.h.UninstallLegacyOcpAgentTask : [UninstallLegacyOcpAgentTask] legacy ocp agent uninstallation succeeded 2024-12-31 18:31:09.412 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:09.422 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,840c9ed384ee0857] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 24, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:31:09.446 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:09.486 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'' on 10.79.169.38 2024-12-31 18:31:09.568 INFO 34018 --- [prometheus-minute-schedule-1,b3f80312fbea9485,4284e06baf379650] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:09.910 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:09.915 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=sudo bash -c 'rm -rf '"'"'/home/admin/ocp_agent/*'"'"'', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:09.918 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] .o.o.s.t.b.h.UninstallLegacyOcpAgentTask : [UninstallLegacyOcpAgentTask] legacy ocp agent uninstallation succeeded 2024-12-31 18:31:09.928 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,352a21993742eab2] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 12, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:31:10.004 INFO 34018 --- [ocp-schedules-7,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:31:10.005 INFO 34018 --- [ocp-schedules-23,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:31:10.287 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:10.290 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:10.448 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,3a3dcb4b79f17abe,34ca51920a52f47d] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/3/subtasks/35/logSegments?taskInstanceId=3&subtaskInstanceId=35, client=10.108.139.108, traceId=3a3dcb4b79f17abe, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getSubtaskLogSegment(Long,Long), args=3,35,] 2024-12-31 18:31:10.556 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,3a3dcb4b79f17abe,34ca51920a52f47d] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/3/subtasks/35/logSegments client=10.108.139.108, traceId=3a3dcb4b79f17abe, duration=121 ms] 2024-12-31 18:31:10.596 WARN 34018 --- [ocp-async-10,816d0876b9f562b3,52246d2f7cb0cabb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:10.603 INFO 34018 --- [ocp-async-2,acc3e60f3d171973,bb24ef853190aaac] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:10.943 INFO 34018 --- [task-coordinator2,,] c.o.o.c.t.e.c.worker.AbstractTaskWorker : Set running subtask to ready, subtaskIds=[55] 2024-12-31 18:31:10.973 WARN 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = ob_memory_percent,ob_tenant_cpu_percent,ob_tenant_disk_usage_v4, label = app=OB, gbLabel = app, ob_cluster_name, ob_cluster_id, tenant_name 2024-12-31 18:31:10.973 WARN 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = ob_memory_percent,ob_tenant_cpu_percent,ob_tenant_disk_usage_v4, label = app=OB, gbLabel = app, ob_cluster_name, ob_cluster_id, tenant_name 2024-12-31 18:31:10.975 WARN 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = sql_all_count,sql_select_count,sql_insert_count,sql_update_count,sql_replace_count,sql_delete_count,sql_other_count,sql_all_rt,sql_select_rt,sql_insert_rt,sql_update_rt,sql_replace_rt,sql_delete_rt,sql_other_rt,sql_local_count,sql_remote_count,sql_distributed_count,sql_local_time,sql_remote_time,sql_distributed_time,active_session,all_session,wait_event_count,system_event_application_total_waits,system_event_configuration_total_waits,system_event_administrative_total_waits,system_event_concurrency_total_waits,system_event_commit_total_waits,system_event_network_total_waits,system_event_user_io_total_waits,system_event_system_io_total_waits,system_event_cluster_total_waits,system_event_other_total_waits,wait_event_rt,system_event_application_time_waited,system_event_configuration_time_waited,system_event_administrative_time_waited,system_event_concurrency_time_waited,system_event_commit_time_waited,system_event_network_time_waited,system_event_user_io_time_waited,system_event_system_io_time_waited,system_event_cluster_time_waited,system_event_other_time_waited,request_enqueue_count,request_dequeue_count,request_queue_time,ob_tenant_cpu_percent,ob_tenant_thread_percent,ob_memory_percent,memstore_percent,rpc_packet_in_rt,rpc_packet_out_rt,rpc_packet_in,rpc_packet_out,opened_cursors_count,max_full_clog_sync_delay_seconds,max_readonly_clog_sync_delay_seconds,max_logonly_clog_sync_delay_seconds,tps,transaction_commit_count,transaction_rollback_count,transaction_timeout_count,trans_sp_total_used_time,trans_distributed_total_used_time,tps_rt,transaction_commit_rt,transaction_rollback_rt,trans_commit_log_count,clog_trans_log_total_size,trans_commit_log_sync_rt,clog_write_disk_rt,memstore_write_lock_succ_count,memstore_write_lock_fail_count,memstore_write_lock_wait_time,transaction_single_partition_count,transaction_multi_partition_count,total_memstore_used,active_memstore_used,major_freeze_trigger,memstore_limit,io_read_count,io_write_count,io_read_rt,io_write_rt,io_read_size,io_writ 2024-12-31 18:31:10.975 WARN 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = sql_all_count,sql_select_count,sql_insert_count,sql_update_count,sql_replace_count,sql_delete_count,sql_other_count,sql_all_rt,sql_select_rt,sql_insert_rt,sql_update_rt,sql_replace_rt,sql_delete_rt,sql_other_rt,sql_local_count,sql_remote_count,sql_distributed_count,sql_local_time,sql_remote_time,sql_distributed_time,active_session,all_session,wait_event_count,system_event_application_total_waits,system_event_configuration_total_waits,system_event_administrative_total_waits,system_event_concurrency_total_waits,system_event_commit_total_waits,system_event_network_total_waits,system_event_user_io_total_waits,system_event_system_io_total_waits,system_event_cluster_total_waits,system_event_other_total_waits,wait_event_rt,system_event_application_time_waited,system_event_configuration_time_waited,system_event_administrative_time_waited,system_event_concurrency_time_waited,system_event_commit_time_waited,system_event_network_time_waited,system_event_user_io_time_waited,system_event_system_io_time_waited,system_event_cluster_time_waited,system_event_other_time_waited,request_enqueue_count,request_dequeue_count,request_queue_time,ob_tenant_cpu_percent,ob_tenant_thread_percent,ob_memory_percent,memstore_percent,rpc_packet_in_rt,rpc_packet_out_rt,rpc_packet_in,rpc_packet_out,opened_cursors_count,max_full_clog_sync_delay_seconds,max_readonly_clog_sync_delay_seconds,max_logonly_clog_sync_delay_seconds,tps,transaction_commit_count,transaction_rollback_count,transaction_timeout_count,trans_sp_total_used_time,trans_distributed_total_used_time,tps_rt,transaction_commit_rt,transaction_rollback_rt,trans_commit_log_count,clog_trans_log_total_size,trans_commit_log_sync_rt,clog_write_disk_rt,memstore_write_lock_succ_count,memstore_write_lock_fail_count,memstore_write_lock_wait_time,transaction_single_partition_count,transaction_multi_partition_count,total_memstore_used,active_memstore_used,major_freeze_trigger,memstore_limit,io_read_count,io_write_count,io_read_rt,io_write_rt,io_read_size,io_writ 2024-12-31 18:31:10.977 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 5, ruleSize = 5. 2024-12-31 18:31:10.977 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 1, ruleSize = 1. 2024-12-31 18:31:11.677 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,403859308cc9849f] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 55, operation:EXECUTE, state: RUNNING 2024-12-31 18:31:11.694 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,9a336fb1eceecc53] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=55, context=Context{parallelIdx=-1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:31:11.674+08:00, sub_task_instance_name=Wait node, sub_task_instance_id=55}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:31:11.706 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,9a336fb1eceecc53] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 55, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:31:12.196 INFO 34018 --- [task-coordinator2,,] c.o.o.c.t.e.c.worker.AbstractTaskWorker : Set running subtask to ready, subtaskIds=[19, 57, 28] 2024-12-31 18:31:12.219 INFO 34018 --- [ocp-schedules-5,da8d98ea2725ffde,8fea82bcaaa352bf] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:31:12.568 INFO 34018 --- [prometheus-minute-schedule-1,6af64ba9d81120f0,3b8324aa58d5a427] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:12.569 INFO 34018 --- [prometheus-hour-schedule-1,dc46cec309cf82b2,2496e3128f43190b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:31:12.596 WARN 34018 --- [ocp-async-7,76c3768ff67c0fc7,8bc3386e78e4fced] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:12.603 INFO 34018 --- [ocp-async-3,09950a57d93c3074,59d5f1e65bc04478] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:12.672 INFO 34018 --- [metric-archive-second-31,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641000, nodeCount=11, affectRows=11 2024-12-31 18:31:12.672 INFO 34018 --- [metric-archive-second-31,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641000, nodeCount=11, validCount=11 2024-12-31 18:31:12.682 INFO 34018 --- [metric-archive-second-40,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641000, nodeCount=362, affectRows=362 2024-12-31 18:31:12.683 INFO 34018 --- [metric-archive-second-40,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641000, nodeCount=361, validCount=361 2024-12-31 18:31:12.690 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,aa37112d42c18f08] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 19, operation:EXECUTE, state: RUNNING 2024-12-31 18:31:12.697 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,aa37112d42c18f08] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 28, operation:EXECUTE, state: RUNNING 2024-12-31 18:31:12.704 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,aa37112d42c18f08] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 57, operation:EXECUTE, state: RUNNING 2024-12-31 18:31:12.705 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,28ae736127fdc89e] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=19, context=Context{parallelIdx=0, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:31:12.688+08:00, sub_task_instance_name=Create random agent credential, sub_task_instance_id=19}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:31:12.711 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,a73a7c65480c93b8] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=28, context=Context{parallelIdx=2, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:31:12.695+08:00, sub_task_instance_name=Create random agent credential, sub_task_instance_id=28}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:31:12.713 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,28ae736127fdc89e] c.o.o.s.c.CredentialServiceImpl : Begin to create or replace credential:CreateCredentialParam(targetType=AGENT, validate=false, name=9dd87266-35f0-4af3-99d9-1c6ef73f053f, description=agent auth credential, obJdbcCredentialProperty=null, sshCredentialProperty=null, agentCredentialProperty=AgentCredentialProperty(username=ocp_agent, hostId=1, authType=OCP-HMACSHA1)) 2024-12-31 18:31:12.714 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,a73a7c65480c93b8] c.o.o.s.c.CredentialServiceImpl : Begin to create or replace credential:CreateCredentialParam(targetType=AGENT, validate=false, name=77838863-4a02-44f4-9f24-c43a32f5e4ed, description=agent auth credential, obJdbcCredentialProperty=null, sshCredentialProperty=null, agentCredentialProperty=AgentCredentialProperty(username=ocp_agent, hostId=3, authType=OCP-HMACSHA1)) 2024-12-31 18:31:12.717 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,606f7b1e2fb6717e] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=57, context=Context{parallelIdx=1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:31:12.703+08:00, sub_task_instance_name=Create random agent credential, sub_task_instance_id=57}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:31:12.722 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,606f7b1e2fb6717e] c.o.o.s.c.CredentialServiceImpl : Begin to create or replace credential:CreateCredentialParam(targetType=AGENT, validate=false, name=1f57c5fb-5560-4db3-8e20-5bd63e8e3f4e, description=agent auth credential, obJdbcCredentialProperty=null, sshCredentialProperty=null, agentCredentialProperty=AgentCredentialProperty(username=ocp_agent, hostId=2, authType=OCP-HMACSHA1)) 2024-12-31 18:31:12.759 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,a73a7c65480c93b8] c.o.o.s.c.CredentialServiceImpl : Success to create or replace credential:CreateCredentialParam(targetType=AGENT, validate=false, name=77838863-4a02-44f4-9f24-c43a32f5e4ed, description=agent auth credential, obJdbcCredentialProperty=null, sshCredentialProperty=null, agentCredentialProperty=AgentCredentialProperty(username=ocp_agent, hostId=3, authType=OCP-HMACSHA1)) 2024-12-31 18:31:12.759 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,606f7b1e2fb6717e] c.o.o.s.c.CredentialServiceImpl : Success to create or replace credential:CreateCredentialParam(targetType=AGENT, validate=false, name=1f57c5fb-5560-4db3-8e20-5bd63e8e3f4e, description=agent auth credential, obJdbcCredentialProperty=null, sshCredentialProperty=null, agentCredentialProperty=AgentCredentialProperty(username=ocp_agent, hostId=2, authType=OCP-HMACSHA1)) 2024-12-31 18:31:12.760 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,28ae736127fdc89e] c.o.o.s.c.CredentialServiceImpl : Success to create or replace credential:CreateCredentialParam(targetType=AGENT, validate=false, name=9dd87266-35f0-4af3-99d9-1c6ef73f053f, description=agent auth credential, obJdbcCredentialProperty=null, sshCredentialProperty=null, agentCredentialProperty=AgentCredentialProperty(username=ocp_agent, hostId=1, authType=OCP-HMACSHA1)) 2024-12-31 18:31:12.766 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,a73a7c65480c93b8] c.o.o.s.t.b.h.CreateAgentCredentialTask : create agent credential success, credential id:4 2024-12-31 18:31:12.768 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,606f7b1e2fb6717e] c.o.o.s.t.b.h.CreateAgentCredentialTask : create agent credential success, credential id:5 2024-12-31 18:31:12.770 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,28ae736127fdc89e] c.o.o.s.t.b.h.CreateAgentCredentialTask : create agent credential success, credential id:6 2024-12-31 18:31:12.776 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,a73a7c65480c93b8] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 28, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:31:12.779 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,606f7b1e2fb6717e] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 57, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:31:12.781 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,28ae736127fdc89e] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 19, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:31:13.290 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:13.291 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:13.431 INFO 34018 --- [task-coordinator2,,] c.o.o.c.t.e.c.worker.AbstractTaskWorker : Set running subtask to ready, subtaskIds=[52] 2024-12-31 18:31:13.717 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,606d05b5728d3611] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 52, operation:EXECUTE, state: RUNNING 2024-12-31 18:31:13.736 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,80dda39554cbe60c] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=52, context=Context{parallelIdx=-1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:31:13.714+08:00, sub_task_instance_name=Wait node, sub_task_instance_id=52}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:31:13.746 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,80dda39554cbe60c] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 52, operation:EXECUTE, state: SUCCESSFUL 2024-12-31 18:31:14.597 WARN 34018 --- [ocp-async-1,2efe7edbff1dd4f2,a7b803fceead08c0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:14.604 INFO 34018 --- [ocp-async-4,b81ce67c0e91b89a,5dba5e65d23ab413] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:14.676 INFO 34018 --- [task-coordinator2,,] c.o.o.c.t.e.c.worker.AbstractTaskWorker : Set running subtask to ready, subtaskIds=[65, 37, 10] 2024-12-31 18:31:14.731 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,1e9538fdf0aa33f3] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 10, operation:EXECUTE, state: RUNNING 2024-12-31 18:31:14.738 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,1e9538fdf0aa33f3] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 37, operation:EXECUTE, state: RUNNING 2024-12-31 18:31:14.746 INFO 34018 --- [subtask-coordinator1,93cfe403787200b1,1e9538fdf0aa33f3] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 65, operation:EXECUTE, state: RUNNING 2024-12-31 18:31:14.746 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=10, context=Context{parallelIdx=0, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:31:14.728+08:00, sub_task_instance_name=Install ocp agent, sub_task_instance_id=10}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:31:14.750 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.s.t.b.host.InstallOcpAgentTask : [InstallOcpAgentTask] started 2024-12-31 18:31:14.754 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=37, context=Context{parallelIdx=2, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:31:14.736+08:00, sub_task_instance_name=Install ocp agent, sub_task_instance_id=37}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:31:14.757 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.s.t.b.host.InstallOcpAgentTask : [InstallOcpAgentTask] started 2024-12-31 18:31:14.766 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=65, context=Context{parallelIdx=1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, target_server_status=RUNNING, subtask_splitter=host_ids, ssh_port=22, service_name=myoceanbase:1735638920, target_zone_status=RUNNING, task_instance_id=3, ob_connect_address=10.79.169.37:2883, task_operation=execute, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy, target_cluster_status=RUNNING, latest_execution_start_time=2024-12-31T18:31:14.744+08:00, sub_task_instance_name=Install ocp agent, sub_task_instance_id=65}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, executor=10.79.169.37 2024-12-31 18:31:14.766 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:31:14.766 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:31:14.770 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.s.t.b.host.InstallOcpAgentTask : [InstallOcpAgentTask] started 2024-12-31 18:31:14.780 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:31:14.785 WARN 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:31:14.786 WARN 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:31:14.787 WARN 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:31:14.791 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:31:14.793 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:31:14.796 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:31:14.802 WARN 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:31:14.805 WARN 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:31:14.808 WARN 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:31:14.809 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.service.task.util.AgentTaskUtils : Create ssh executor from task context 2024-12-31 18:31:14.812 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.service.task.util.AgentTaskUtils : Create ssh executor from task context 2024-12-31 18:31:14.815 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.service.task.util.AgentTaskUtils : Create ssh executor from task context 2024-12-31 18:31:14.821 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.service.task.util.AgentTaskUtils : CredentialId in context, use specific credential 2024-12-31 18:31:14.821 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.service.task.util.AgentTaskUtils : CredentialId in context, use specific credential 2024-12-31 18:31:14.824 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.service.task.util.AgentTaskUtils : CredentialId in context, use specific credential 2024-12-31 18:31:14.847 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:14.849 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:14.850 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:14.872 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:14.877 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:14.881 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:14.909 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:14.917 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:14.921 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:14.930 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:14.941 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:14.949 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:14.970 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.37 2024-12-31 18:31:14.981 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.36 2024-12-31 18:31:14.989 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.38 2024-12-31 18:31:15.036 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.040 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.049 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.052 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.076 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:15.088 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:15.100 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.113 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.139 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.36 2024-12-31 18:31:15.153 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.37 2024-12-31 18:31:15.193 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.197 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.227 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.s.c.AgentInstallationTaskService : download and install ocp-agent start... 2024-12-31 18:31:15.229 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.234 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.250 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:15.256 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.s.c.AgentInstallationTaskService : download and install ocp-agent start... 2024-12-31 18:31:15.270 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:15.276 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.291 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.317 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.36 2024-12-31 18:31:15.331 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.37 2024-12-31 18:31:15.367 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.371 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.388 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.392 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.407 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:15.428 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:15.433 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.451 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.473 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.36 2024-12-31 18:31:15.491 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.37 2024-12-31 18:31:15.514 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.518 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.533 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.537 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62888$" { print $4"\t"$6 }'"'"' <<<"$out"', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.544 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.547 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.554 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:15.568 INFO 34018 --- [prometheus-minute-schedule-1,c95635fb7721dc3d,0755f0cd9ba65f37] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:15.573 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:15.576 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.584 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:15.601 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.606 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.616 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.36 2024-12-31 18:31:15.641 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.38 2024-12-31 18:31:15.645 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.37 2024-12-31 18:31:15.659 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.663 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.699 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:15.700 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.705 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.721 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.739 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:15.761 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.761 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.36 2024-12-31 18:31:15.800 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.37 2024-12-31 18:31:15.805 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.808 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.846 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:15.852 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.855 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.869 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.891 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:15.909 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.36 2024-12-31 18:31:15.917 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.953 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.956 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.37 2024-12-31 18:31:15.957 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:15.993 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.36 2024-12-31 18:31:16.017 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.018 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.021 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.057 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.37 2024-12-31 18:31:16.058 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.36 2024-12-31 18:31:16.079 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.101 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.36, result: SshResult(host=10.79.169.36, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.104 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.36,result:SshResult(host=10.79.169.36, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.108 ERROR 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.c.t.e.c.w.subtask.SubtaskExecutor : result not match after try 3 times java.lang.RuntimeException: result not match after try 3 times at com.oceanbase.ocp.common.lang.pattern.Retry.lambda$executeUntilWithLimit$0(Retry.java:62) at com.oceanbase.ocp.common.lang.pattern.Retry.executeUntilWithLimit(Retry.java:93) at com.oceanbase.ocp.common.lang.pattern.Retry.executeUntilWithLimit(Retry.java:61) at com.oceanbase.ocp.common.lang.pattern.Retry.executeUntilWithLimit(Retry.java:56) at com.oceanbase.ocp.executor.executor.SshExecutor.downloadFile(SshExecutor.java:398) at com.oceanbase.ocp.executor.executor.SshExecutor.installPackage(SshExecutor.java:237) at com.oceanbase.ocp.service.compute.AgentInstallationTaskService.installOcpAgentRpm(AgentInstallationTaskService.java:218) at com.oceanbase.ocp.service.compute.AgentInstallationTaskService$$FastClassBySpringCGLIB$$f7a6037f.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.service.compute.AgentInstallationTaskService$$EnhancerBySpringCGLIB$$222e8250.installOcpAgentRpm() at com.oceanbase.ocp.service.task.business.host.InstallOcpAgentTask.run(InstallOcpAgentTask.java:63) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.execute(JavaSubtaskRunner.java:64) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.doRun(JavaSubtaskRunner.java:32) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.run(JavaSubtaskRunner.java:26) at com.oceanbase.ocp.core.task.engine.runner.RunnerFactory.doRun(RunnerFactory.java:76) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.doRun(SubtaskExecutor.java:206) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.redirectConsoleOutput(SubtaskExecutor.java:200) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.lambda$submit$2(SubtaskExecutor.java:137) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-12-31 18:31:16.119 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.37 2024-12-31 18:31:16.121 INFO 34018 --- [manual-subtask-executor16,533c711d5df1d20e,23cea25f20a5de52] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 37, operation:EXECUTE, state: FAILED 2024-12-31 18:31:16.148 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.151 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=sudo bash -c 'out=$(netstat -ant) && awk '"'"'$4~":62889$" { print $4"\t"$6 }'"'"' <<<"$out"', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.165 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.37, result: SshResult(host=10.79.169.37, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.168 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.37,result:SshResult(host=10.79.169.37, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.171 ERROR 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.c.t.e.c.w.subtask.SubtaskExecutor : result not match after try 3 times java.lang.RuntimeException: result not match after try 3 times at com.oceanbase.ocp.common.lang.pattern.Retry.lambda$executeUntilWithLimit$0(Retry.java:62) at com.oceanbase.ocp.common.lang.pattern.Retry.executeUntilWithLimit(Retry.java:93) at com.oceanbase.ocp.common.lang.pattern.Retry.executeUntilWithLimit(Retry.java:61) at com.oceanbase.ocp.common.lang.pattern.Retry.executeUntilWithLimit(Retry.java:56) at com.oceanbase.ocp.executor.executor.SshExecutor.downloadFile(SshExecutor.java:398) at com.oceanbase.ocp.executor.executor.SshExecutor.installPackage(SshExecutor.java:237) at com.oceanbase.ocp.service.compute.AgentInstallationTaskService.installOcpAgentRpm(AgentInstallationTaskService.java:218) at com.oceanbase.ocp.service.compute.AgentInstallationTaskService$$FastClassBySpringCGLIB$$f7a6037f.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.service.compute.AgentInstallationTaskService$$EnhancerBySpringCGLIB$$222e8250.installOcpAgentRpm() at com.oceanbase.ocp.service.task.business.host.InstallOcpAgentTask.run(InstallOcpAgentTask.java:63) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.execute(JavaSubtaskRunner.java:64) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.doRun(JavaSubtaskRunner.java:32) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.run(JavaSubtaskRunner.java:26) at com.oceanbase.ocp.core.task.engine.runner.RunnerFactory.doRun(RunnerFactory.java:76) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.doRun(SubtaskExecutor.java:206) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.redirectConsoleOutput(SubtaskExecutor.java:200) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.lambda$submit$2(SubtaskExecutor.java:137) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-12-31 18:31:16.171 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.s.c.AgentInstallationTaskService : download and install ocp-agent start... 2024-12-31 18:31:16.181 INFO 34018 --- [manual-subtask-executor14,533c711d5df1d20e,12c6b94e6b678b1a] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 10, operation:EXECUTE, state: FAILED 2024-12-31 18:31:16.190 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:16.219 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.258 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.38 2024-12-31 18:31:16.292 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:16.293 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:16.597 WARN 34018 --- [ocp-async-5,99d3558e5c23d414,d8fab85409805b63] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:16.604 INFO 34018 --- [ocp-async-10,34cdbd9ee6a6ce88,d3e6098df9adefd8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:16.715 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.719 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.755 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:16.784 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:16.824 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.38 2024-12-31 18:31:17.351 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:17.356 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:17.391 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:17.421 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:17.460 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.38 2024-12-31 18:31:17.911 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:17.916 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:17.951 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:17.980 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:18.020 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.38 2024-12-31 18:31:18.457 INFO 34018 --- [ocp-schedules-15,1efe2cc9b9b1748d,ad3f4ae4e54a57c1] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:31:18.458 INFO 34018 --- [ocp-schedules-9,7866052701aa02c8,b63cee630d7b68f8] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:31:18.458 INFO 34018 --- [ocp-schedules-8,122082954cab1cc8,2c9a167b95fa54b2] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:31:18.459 INFO 34018 --- [ocp-schedules-1,1891c4fe56516681,54675a06315ab879] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:31:18.464 INFO 34018 --- [ocp-schedules-8,122082954cab1cc8,2c9a167b95fa54b2] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:31:18.464 INFO 34018 --- [ocp-schedules-15,1efe2cc9b9b1748d,ad3f4ae4e54a57c1] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:31:18.464 INFO 34018 --- [ocp-schedules-9,7866052701aa02c8,b63cee630d7b68f8] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:31:18.466 INFO 34018 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : skip cluster not running and unavailable, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:31:18.466 INFO 34018 --- [ocp-schedules-4,c4495d9726a48c39,282160001d92e5b0] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:31:18.470 INFO 34018 --- [ocp-schedules-21,58a045e366f9fa08,fdbc43649bc3d60b] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:31:18.470 INFO 34018 --- [ocp-schedules-21,58a045e366f9fa08,fdbc43649bc3d60b] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:31:18.470 INFO 34018 --- [ocp-schedules-18,dfa78bc35c964e91,1826694ac4b446a1] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:31:18.470 INFO 34018 --- [ocp-schedules-18,dfa78bc35c964e91,1826694ac4b446a1] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:31:18.471 INFO 34018 --- [ocp-schedules-10,050dc04096dcb560,cbc4d5207ce132ed] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:31:18.471 INFO 34018 --- [ocp-schedules-10,050dc04096dcb560,cbc4d5207ce132ed] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:31:18.473 INFO 34018 --- [Check status for all clusters1,,] c.o.o.m.p.OcpMetricPublishServiceImpl : Register meter successfully, metric = Metric{name='ob_cluster_status_check', labels={app=OB, check_item=cluster connection, failed_reason=-, ob_cluster_id=1735638920, ob_cluster_name=myoceanbase, ob_cluster_status=TAKINGOVER}}, value: -1, timestamp: 1735641078 : 2024-12-31 10:31:18 2024-12-31 18:31:18.504 INFO 34018 --- [ocp-async-10,c3882b6e7a774601,14b636e05b887d97] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:31:18.529 INFO 34018 --- [ocp-schedules-24,92cffd0fcbf35dc7,9a1b30aa1bf83e84] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:31:18.561 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:18.565 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:18.568 INFO 34018 --- [prometheus-minute-schedule-1,6975a32dfc30fcc7,2faeedf6d64ac581] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:18.580 INFO 34018 --- [ocp-schedules-6,66cd41da1206b413,7e36d6a43aeb27ca] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:31:18.587 INFO 34018 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] cluster is not accessible, skip sync cluster, clusterId=1, status=TAKINGOVER 2024-12-31 18:31:18.587 INFO 34018 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=false, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:31:18.587 INFO 34018 --- [Sync all clusters1,,] c.o.o.m.p.OcpMetricPublishServiceImpl : Register meter successfully, metric = Metric{name='ob_cluster_sync', labels={app=OB, failed_reason=-, ob_cluster_id=1735638920, ob_cluster_name=myoceanbase, ob_cluster_status=TAKINGOVER}}, value: -1, timestamp: 1735641078 : 2024-12-31 10:31:18 2024-12-31 18:31:18.588 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:31:18.588127+08:00, lastProcessTime=2024-12-31T18:31:08.586984+08:00 2024-12-31 18:31:18.597 WARN 34018 --- [ocp-async-7,f431a4d1eb41c0ee,d98ab83ba46a4941] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:18.604 INFO 34018 --- [ocp-async-3,2c98aa891977b56b,71f5b1c751f69feb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:18.601 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:18.633 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:18.673 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.38 2024-12-31 18:31:18.740 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:31:18.588127+08:00 2024-12-31 18:31:19.191 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:19.195 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=sudo curl -s -S -k -o '/tmp'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' 'http://10.79.169.37:8080/api/v2/object-storage/sys-package/ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm', out=, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:19.230 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: echo 1 on 10.79.169.38 2024-12-31 18:31:19.260 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: echo 1 on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=echo 1, out=1, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:19.293 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:19.295 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:19.300 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand begin: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.38 2024-12-31 18:31:19.857 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] com.oceanbase.ocp.common.ssh.SshUtils : SSH executeCommand end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.38, result: SshResult(host=10.79.169.38, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:19.861 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.e.internal.template.SshTemplate : SSH execute end: sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }' on 10.79.169.38,result:SshResult(host=10.79.169.38, username=admin, command=sudo sha1sum '/tmp/'/'ocp-agent-ce-4.3.2-20241012145836.el7.x86_64.rpm' | awk '{ print $1 }', out=b5a478c4f4da0e1c1fc43739757f6ef2010119d9, err=, extOut=null, exitStatus=0) 2024-12-31 18:31:19.865 ERROR 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.c.t.e.c.w.subtask.SubtaskExecutor : result not match after try 3 times java.lang.RuntimeException: result not match after try 3 times at com.oceanbase.ocp.common.lang.pattern.Retry.lambda$executeUntilWithLimit$0(Retry.java:62) at com.oceanbase.ocp.common.lang.pattern.Retry.executeUntilWithLimit(Retry.java:93) at com.oceanbase.ocp.common.lang.pattern.Retry.executeUntilWithLimit(Retry.java:61) at com.oceanbase.ocp.common.lang.pattern.Retry.executeUntilWithLimit(Retry.java:56) at com.oceanbase.ocp.executor.executor.SshExecutor.downloadFile(SshExecutor.java:398) at com.oceanbase.ocp.executor.executor.SshExecutor.installPackage(SshExecutor.java:237) at com.oceanbase.ocp.service.compute.AgentInstallationTaskService.installOcpAgentRpm(AgentInstallationTaskService.java:218) at com.oceanbase.ocp.service.compute.AgentInstallationTaskService$$FastClassBySpringCGLIB$$f7a6037f.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.service.compute.AgentInstallationTaskService$$EnhancerBySpringCGLIB$$222e8250.installOcpAgentRpm() at com.oceanbase.ocp.service.task.business.host.InstallOcpAgentTask.run(InstallOcpAgentTask.java:63) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.execute(JavaSubtaskRunner.java:64) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.doRun(JavaSubtaskRunner.java:32) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.run(JavaSubtaskRunner.java:26) at com.oceanbase.ocp.core.task.engine.runner.RunnerFactory.doRun(RunnerFactory.java:76) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.doRun(SubtaskExecutor.java:206) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.redirectConsoleOutput(SubtaskExecutor.java:200) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.lambda$submit$2(SubtaskExecutor.java:137) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-12-31 18:31:19.878 INFO 34018 --- [manual-subtask-executor15,533c711d5df1d20e,ce88fad72568c125] c.o.o.c.t.e.c.w.subtask.SubtaskAccessor : Set state for subtask: 65, operation:EXECUTE, state: FAILED 2024-12-31 18:31:20.597 WARN 34018 --- [ocp-async-9,28b1c6d185238eea,bad7bf9a5e90ee22] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:20.604 INFO 34018 --- [ocp-async-4,5fe243343afb20c6,bc411746c511bb77] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:20.855 INFO 34018 --- [task-coordinator2,,] c.o.o.c.t.e.c.worker.RunningTaskWorker : Mark failed task, entity=TaskInstanceEntity{id=3, name='Take over primary OB cluster', taskDefinitionId=-1, state=RUNNING, type=MANUAL, clusterId=1, tenantId=null, hostId=null, creator='admin', executor='10.79.169.37', argument=Argument{parallelIdx=-1, stringMap={cluster_version=4.2.1.10, cluster_name=myoceanbase, ssh_port=22, prohibit_rollback=false, service_name=myoceanbase:1735638920, ob_connect_address=10.79.169.37:2883, cluster_type=PRIMARY, service_version=4.2.1.10, host_credential_id=1, ob_cluster_id=1735638920, cluster_id=1, root_sys_password=xxx service_type=OB_CLUSTER, obproxy_proxyro_password=xxx ob_data_dir=/data2/ob-home/myoceanbase/oceanbase/store, connection_mode=proxy}, listMap={add_region_ids=[2], server_ids=[1, 2, 3], add_idc_ids=[1, 2, 3], all_host_ids=[1, 2, 3], add_host_ids=[1, 2, 3], host_ids=[1, 2, 3], zone_names=[zone1, zone3, zone2]}}, createTime=2024-12-31T18:30:50+08:00, startTime=2024-12-31T18:30:50.864+08:00, endTime=null, subtasks=[SubtaskInstanceEntity{id=15, name=Register config url, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.cluster.RegisterConfigUrlTask, seriesId=13, startTime=null, endTime=null}, SubtaskInstanceEntity{id=40, name=Wait node, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.WaitNode, seriesId=63, startTime=null, endTime=null}, SubtaskInstanceEntity{id=29, name=Wait node, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.WaitNode, seriesId=14, startTime=null, endTime=null}, SubtaskInstanceEntity{id=32, name=Record root service list, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.cluster.RecordRsListTask, seriesId=15, startTime=null, endTime=null}, SubtaskInstanceEntity{id=68, name=Create default user, state=PENDING, operation=EXECUTE, className=com.oceanbase.ocp.service.task.business.cluster.CreateDefaultUserTask, seriesId=39, startTime=null, endTime=null}, SubtaskInstanceEntity{id=4, name=Update zone status, state=PENDI 2024-12-31 18:31:20.886 WARN 34018 --- [task-coordinator2,,] c.o.o.c.t.e.c.worker.RunningTaskWorker : Execute hook failed, ex: java.lang.NumberFormatException: null at java.lang.Long.parseLong(Long.java:552) at java.lang.Long.parseLong(Long.java:631) at com.oceanbase.ocp.core.task.common.Context.getLong(Context.java:188) at com.oceanbase.ocp.service.operation.OperationAlarmService.infoAfterTaskTerminate(OperationAlarmService.java:184) at com.oceanbase.ocp.core.task.engine.coordinator.worker.RunningTaskWorker.lambda$executePostTaskHooks$5(RunningTaskWorker.java:161) at java.util.ArrayList.forEach(ArrayList.java:1259) at com.oceanbase.ocp.core.task.engine.coordinator.worker.RunningTaskWorker.executePostTaskHooks(RunningTaskWorker.java:159) at com.oceanbase.ocp.core.task.engine.coordinator.worker.RunningTaskWorker.lockAndScheduleRunningTask(RunningTaskWorker.java:113) at com.oceanbase.ocp.core.task.engine.coordinator.worker.RunningTaskWorker.work(RunningTaskWorker.java:79) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.nonExceptionRun(TaskCoordinator.java:119) at com.oceanbase.ocp.core.task.engine.coordinator.TaskCoordinator.lambda$initRunningTaskWorkers$3(TaskCoordinator.java:106) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-12-31 18:31:20.887 INFO 34018 --- [task-coordinator2,,] c.o.ocp.service.audit.AuditEventService : begin update audit event, taskId:3, status:FAILED 2024-12-31 18:31:21.568 INFO 34018 --- [prometheus-minute-schedule-1,2bf50c9f415e36f6,8c48858a280c474d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:22.273 INFO 34018 --- [ocp-schedules-25,6c3f54a439b95319,7ba15f48c112eaf8] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:31:22.295 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:22.298 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:22.597 WARN 34018 --- [ocp-async-6,f031d7678119dc41,315d15b49a19da47] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:22.604 INFO 34018 --- [ocp-async-10,53007a8476b1922c,8848489e1000fecf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:22.891 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,4c48afdb40a38dd3,548f6ce56020c192] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/3?taskInstanceId=3, client=10.108.139.108, traceId=4c48afdb40a38dd3, method=SuccessResponse com.oceanbase.ocp.server.common.controller.TaskController.getTaskInstance(Long), args=3,] 2024-12-31 18:31:22.939 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,4c48afdb40a38dd3,548f6ce56020c192] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/3 client=10.108.139.108, traceId=4c48afdb40a38dd3, duration=60 ms] 2024-12-31 18:31:24.568 INFO 34018 --- [prometheus-minute-schedule-1,4d61ca6c22d34884,1df62e7c707c1c79] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:24.598 WARN 34018 --- [ocp-async-7,30a83c9b2c0d317a,6aeaada0e41eb715] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:24.604 INFO 34018 --- [ocp-async-8,6837d79fb08c7f01,cccc6e5f4b4adb43] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:25.009 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,b5e7c077729e4230,bd8aed550f8326e4] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/3/subtasks/35/logSegments?taskInstanceId=3&subtaskInstanceId=35, client=10.108.139.108, traceId=b5e7c077729e4230, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getSubtaskLogSegment(Long,Long), args=3,35,] 2024-12-31 18:31:25.038 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,b5e7c077729e4230,bd8aed550f8326e4] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/3/subtasks/35/logSegments client=10.108.139.108, traceId=b5e7c077729e4230, duration=40 ms] 2024-12-31 18:31:25.298 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:25.301 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:26.598 WARN 34018 --- [ocp-async-9,868eda5743e285a3,ca6ee3f3d22b2805] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:26.605 INFO 34018 --- [ocp-async-1,c91573558ef358ee,fac506d6ade21fd3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:27.568 INFO 34018 --- [prometheus-minute-schedule-1,902713db96653a30,2c62c13f2187578f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:28.301 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:28.303 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:28.470 INFO 34018 --- [ocp-schedules-9,7866052701aa02c8,b63cee630d7b68f8] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2024-12-31 18:31:28.474 INFO 34018 --- [ocp-schedules-15,1efe2cc9b9b1748d,ad3f4ae4e54a57c1] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:31:28.504 INFO 34018 --- [ocp-async-1,d206aff9292efef0,8bc64d432f89a614] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:31:28.531 INFO 34018 --- [ocp-schedules-30,3b146b2f13700f54,51227b8d27f07dfa] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:31:28.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:31:28.589132+08:00, lastProcessTime=2024-12-31T18:31:18.588127+08:00 2024-12-31 18:31:28.598 WARN 34018 --- [ocp-async-5,786bfed98a800385,1b404c9710dae5b6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:28.605 INFO 34018 --- [ocp-async-10,78462b7a736e21a7,1f86ad8c0125b782] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:28.837 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:31:28.589132+08:00 2024-12-31 18:31:29.190 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,570d47915c790093,ae981c7dca466a64] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/3/subtasks/35/logSegments?taskInstanceId=3&subtaskInstanceId=35, client=10.108.139.108, traceId=570d47915c790093, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getSubtaskLogSegment(Long,Long), args=3,35,] 2024-12-31 18:31:29.197 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,570d47915c790093,ae981c7dca466a64] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/3/subtasks/35/logSegments client=10.108.139.108, traceId=570d47915c790093, duration=17 ms] 2024-12-31 18:31:29.296 INFO 34018 --- [ocp-schedules-9,aba2cd58e8ab9547,37280bbc94baaf3f] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:31:29.307 INFO 34018 --- [ocp-schedules-9,aba2cd58e8ab9547,37280bbc94baaf3f] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:31:29.307 INFO 34018 --- [ocp-schedules-9,aba2cd58e8ab9547,37280bbc94baaf3f] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:31:30.568 INFO 34018 --- [prometheus-minute-schedule-1,fe0351a5e8e37ffc,68021fa3529e8b4e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:30.598 WARN 34018 --- [ocp-async-7,f4d9201ddf454e8f,d245100a020974b8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:30.605 INFO 34018 --- [ocp-async-2,ae1486c0e71c6612,87c995fc0a9cadbf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:31.303 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:31.305 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:32.315 INFO 34018 --- [ocp-schedules-24,7b0902359d8085d7,79a29f9620e07643] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:31:32.598 WARN 34018 --- [ocp-async-9,37f7cafbb82fc3ab,ad14631ba6f42b04] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:32.605 INFO 34018 --- [ocp-async-3,dfde06f8d644603d,105cd84a33e13be0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:33.568 INFO 34018 --- [prometheus-minute-schedule-1,496493196dc07295,cab02bf68cddf3a5] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:34.305 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:34.307 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:34.598 WARN 34018 --- [ocp-async-4,bb14bebe88903bc8,fb380563e8af5011] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:34.605 INFO 34018 --- [ocp-async-5,0597eea8807279d9,c26e34ec1b6c74fb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:36.568 INFO 34018 --- [prometheus-minute-schedule-1,7aabe63972e1cf16,569d1eb6becd1a99] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:36.569 INFO 34018 --- [prometheus-cache-monitor1,cf24303f45016665,8dad04bb5720f803] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1442,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":379,"seriesIdKeySize":379,"secondWriteQueue":0,"minuteWriteCacheSize":372} 2024-12-31 18:31:36.569 INFO 34018 --- [prometheus-cache-monitor1,cf24303f45016665,8dad04bb5720f803] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=45, ob_cluster_status_check=7, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, ob_cluster_sync=6, http_server_requests_seconds_count=45, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:31:36.599 WARN 34018 --- [ocp-async-5,4e4237e907a25754,682888b7ad1ecefa] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:36.605 INFO 34018 --- [ocp-async-10,7dcf9ebb8620b854,e4f84d7286c0f0e2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:37.307 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:37.309 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:38.201 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,cd8478beecf0d972,ab4df26daf5ace13] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/3/subtasks/10/logSegments?taskInstanceId=3&subtaskInstanceId=10, client=10.108.139.108, traceId=cd8478beecf0d972, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getSubtaskLogSegment(Long,Long), args=3,10,] 2024-12-31 18:31:38.209 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,cd8478beecf0d972,ab4df26daf5ace13] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/3/subtasks/10/logSegments client=10.108.139.108, traceId=cd8478beecf0d972, duration=16 ms] 2024-12-31 18:31:38.504 INFO 34018 --- [ocp-async-10,e4b76fa0e68bd0aa,30f2bfbb2d1bf600] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:31:38.533 INFO 34018 --- [ocp-schedules-27,4220b933162fe960,773939b4d0765c6a] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:31:38.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:31:38.589949+08:00, lastProcessTime=2024-12-31T18:31:28.589132+08:00 2024-12-31 18:31:38.599 WARN 34018 --- [ocp-async-1,e665f2df647be683,234045a12f0a4adc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:38.606 INFO 34018 --- [ocp-async-8,5f70c8d2be1c200d,cf7509ca192eaadc] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:38.759 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:31:38.589949+08:00 2024-12-31 18:31:39.568 INFO 34018 --- [prometheus-minute-schedule-1,9b2707b996af4395,45ae80c1629495b3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:40.003 INFO 34018 --- [ocp-schedules-24,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:31:40.004 INFO 34018 --- [ocp-schedules-20,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:31:40.310 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:40.312 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:40.599 WARN 34018 --- [ocp-async-3,331434bebd71d6ae,eb2509abbdc81371] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:40.606 INFO 34018 --- [ocp-async-6,ca94d8c9211bb192,bc9445a1ee8e8350] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:42.374 INFO 34018 --- [ocp-schedules-19,a6d712446f466cbd,b9b72b0858a136a6] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:31:42.568 INFO 34018 --- [prometheus-minute-schedule-1,5e03ef45e60e2de8,8d6a84c36f095620] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:42.599 WARN 34018 --- [ocp-async-7,ee9c78be9c40b5a6,2bb9de1505642ef8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:42.606 INFO 34018 --- [ocp-async-10,428ef77454ff3887,b5efd76069325e92] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:43.312 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:43.314 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:44.599 WARN 34018 --- [ocp-async-1,42ffa65912b6aa80,e594e801bb592a8c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:44.606 INFO 34018 --- [ocp-async-9,c11a9c2d16967879,9614979b94fe2b28] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:45.568 INFO 34018 --- [prometheus-minute-schedule-1,be732c11a2333a51,61a2ae73ab010ef1] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:46.314 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:46.316 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:46.599 WARN 34018 --- [ocp-async-8,d9c6ab245a42e200,9a610fe575825d7a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:46.606 INFO 34018 --- [ocp-async-4,89f55bec46652537,06dbbaec74701df8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:48.456 INFO 34018 --- [ocp-schedules-6,32e57365704b0571,29c70edbec272aa9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:31:48.457 INFO 34018 --- [ocp-schedules-21,9e8f3ee452720de6,d75cbd4f5294355f] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:31:48.458 INFO 34018 --- [ocp-schedules-30,08285678c6fba33e,c5305fde0cbb7fab] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:31:48.458 INFO 34018 --- [ocp-schedules-7,a775025988bbd8e4,0defb3999a063880] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:31:48.459 INFO 34018 --- [ocp-schedules-19,aba878ba899330e2,b46d03d1f13ea864] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:31:48.463 INFO 34018 --- [ocp-schedules-21,9e8f3ee452720de6,d75cbd4f5294355f] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:31:48.465 INFO 34018 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : skip cluster not running and unavailable, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:31:48.465 INFO 34018 --- [ocp-schedules-6,32e57365704b0571,29c70edbec272aa9] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:31:48.466 INFO 34018 --- [ocp-schedules-20,2cfefbac06f2acd5,e10547e3b0e6fa69] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:31:48.467 INFO 34018 --- [ocp-schedules-30,08285678c6fba33e,c5305fde0cbb7fab] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:31:48.468 INFO 34018 --- [ocp-schedules-7,a775025988bbd8e4,0defb3999a063880] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:31:48.472 INFO 34018 --- [ocp-schedules-10,9952983d5a4ad714,551bd31ff5ea6227] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:31:48.472 INFO 34018 --- [ocp-schedules-24,0a41fda7895e4590,0ca907c6a16fcd4e] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:31:48.472 INFO 34018 --- [ocp-schedules-10,9952983d5a4ad714,551bd31ff5ea6227] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:31:48.472 INFO 34018 --- [ocp-schedules-24,0a41fda7895e4590,0ca907c6a16fcd4e] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:31:48.473 INFO 34018 --- [ocp-schedules-26,e03ca31510624ff2,9b2008764044ffa2] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:31:48.473 INFO 34018 --- [ocp-schedules-26,e03ca31510624ff2,9b2008764044ffa2] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:31:48.489 INFO 34018 --- [ocp-schedules-22,95abde0a5025d762,e89dfdbbf4bb78d5] c.o.o.s.common.scheduled.PerfSchedules : Collect high risk sql audit stat, time=2024-12-31T18:31:48.489+08:00, tenantSize=0 2024-12-31 18:31:48.505 INFO 34018 --- [ocp-async-7,d2fdff643614b025,e143e3267c5ffb74] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:31:48.516 INFO 34018 --- [ocp-schedules-12,517ce1a807f07e0b,9cd1f7a0b2c4719a] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1442,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":379,"seriesIdKeySize":379,"secondWriteQueue":0,"minuteWriteCacheSize":372} 2024-12-31 18:31:48.516 INFO 34018 --- [ocp-schedules-12,517ce1a807f07e0b,9cd1f7a0b2c4719a] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=45, ob_cluster_status_check=7, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, ob_cluster_sync=6, http_server_requests_seconds_count=45, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:31:48.527 INFO 34018 --- [ocp-schedules-13,8645f9eff475f74e,f9438030a9fab659] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2024-12-31 18:31:48.532 INFO 34018 --- [ocp-schedules-13,8645f9eff475f74e,f9438030a9fab659] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:31:48.536 INFO 34018 --- [ocp-schedules-15,2f6804c7a038fac6,dc746b796fcde098] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:31:48.545 INFO 34018 --- [ocp-schedules-9,a136adaa1e37cb9d,a224547750750857] c.o.o.s.common.scheduled.HostSchedules : Refresh all agent config, hostIps=[] 2024-12-31 18:31:48.545 INFO 34018 --- [ocp-schedules-9,a136adaa1e37cb9d,a224547750750857] c.o.o.s.common.scheduled.HostSchedules : Refresh all agent config finished 2024-12-31 18:31:48.563 INFO 34018 --- [ocp-schedules-16,73cc42da65c2a171,937f1d37090521e1] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:31:48.564 INFO 34018 --- [ocp-schedules-7,02a919f73d4473a5,925d6428de0ead17] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:31:48.564 INFO 34018 --- [ocp-schedules-7,02a919f73d4473a5,925d6428de0ead17] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:31:48.564 INFO 34018 --- [ocp-schedules-11,a8da06c25c4e49e6,f606310163a86db9] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:31:48.565 INFO 34018 --- [ocp-schedules-20,7a2fe9b6c019c737,91b06d3ddc1dd8f2] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:31:48.565 INFO 34018 --- [ocp-schedules-20,7a2fe9b6c019c737,91b06d3ddc1dd8f2] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:31:48.567 INFO 34018 --- [ocp-schedules-24,73fef8aa9e3c7683,80d7cbd365ad3cd6] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:31:48.568 INFO 34018 --- [ocp-schedules-16,73cc42da65c2a171,937f1d37090521e1] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:31:48.568 INFO 34018 --- [prometheus-minute-schedule-1,49d9cb164678a35f,bb1b9d527ec91bf0] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:48.569 INFO 34018 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2024-12-31 18:31:48.571 INFO 34018 --- [ocp-schedules-24,73fef8aa9e3c7683,80d7cbd365ad3cd6] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:31:48.583 INFO 34018 --- [ocp-schedules-14,dbacd9a2ffedf1d5,e4f207274ee299a1] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:31:48.585 INFO 34018 --- [ocp-schedules-25,2a8dc527151ce025,9ea63bd260f49951] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[10.79.169.37, 10.79.169.38, 10.79.169.36] 2024-12-31 18:31:48.585 INFO 34018 --- [ocp-schedules-25,2a8dc527151ce025,9ea63bd260f49951] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=2 2024-12-31 18:31:48.585 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=1 2024-12-31 18:31:48.585 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=3 2024-12-31 18:31:48.588 INFO 34018 --- [ocp-schedules-8,122082954cab1cc8,2c9a167b95fa54b2] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:31:48.588 INFO 34018 --- [ocp-schedules-8,73670257e3164b3c,3d82564292962193] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:31:48.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:31:48.589287+08:00, lastProcessTime=2024-12-31T18:31:38.589949+08:00 2024-12-31 18:31:48.590 INFO 34018 --- [ocp-schedules-29,906ea279465b0d07,994becc57e60bb71] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:31:48.590+08:00, clusters=[1] 2024-12-31 18:31:48.592 INFO 34018 --- [ocp-schedules-8,73670257e3164b3c,3d82564292962193] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:31:48.597 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:31:48.598 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:31:48.598 INFO 34018 --- [ocp-schedules-25,2a8dc527151ce025,9ea63bd260f49951] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:31:48.598 INFO 34018 --- [ocp-schedules-6,efef6ee02f4a0737,209e9470ae49202b] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:31:48.599 WARN 34018 --- [ocp-async-1,05fb0b57ee0c663c,016278ba6cc195d3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:48.600 WARN 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:31:48.600 WARN 34018 --- [ocp-schedules-25,2a8dc527151ce025,9ea63bd260f49951] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:31:48.601 WARN 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:31:48.601 INFO 34018 --- [ocp-schedules-19,7de7fc5de6e2df97,86568fcdfc2f2897] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:31:48.601+08:00, clusters=[1] 2024-12-31 18:31:48.601 INFO 34018 --- [ocp-schedules-7,02a919f73d4473a5,925d6428de0ead17] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:31:48.601 INFO 34018 --- [ocp-schedules-7,02a919f73d4473a5,925d6428de0ead17] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:31:48.601 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:31:48.601 INFO 34018 --- [ocp-schedules-25,2a8dc527151ce025,9ea63bd260f49951] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:31:48.601 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:31:48.603 WARN 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:31:48.603 WARN 34018 --- [ocp-schedules-25,2a8dc527151ce025,9ea63bd260f49951] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:31:48.604 WARN 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:31:48.607 INFO 34018 --- [ocp-async-2,5ec20994fd82adbd,a663916c4b88c8f2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:48.608 INFO 34018 --- [ocp-schedules-10,f901587813b7ec44,3c0509ddaa8fff67] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:31:48.617 INFO 34018 --- [ocp-schedules-6,efef6ee02f4a0737,209e9470ae49202b] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:31:48.617 INFO 34018 --- [ocp-schedules-6,efef6ee02f4a0737,209e9470ae49202b] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2024-12-31 18:31:48.621 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.e.internal.connector.Connectors : init global executor service. 2024-12-31 18:31:48.628 INFO 34018 --- [ocp-schedules-19,7de7fc5de6e2df97,86568fcdfc2f2897] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster myoceanbase, trans stat result is empty. 2024-12-31 18:31:48.632 INFO 34018 --- [ocp-schedules-29,906ea279465b0d07,994becc57e60bb71] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster myoceanbase for slowSqlStat, sql count is 0. 2024-12-31 18:31:48.634 ERROR 34018 --- [ocp-schedules-13,8645f9eff475f74e,f9438030a9fab659] .o.o.s.t.b.c.AbstractShardingClusterTask : process cluster error java.util.concurrent.ExecutionException: com.oceanbase.ocp.service.profile.exception.CredentialMissingException: [OCP CredentialMissingException]: status=428 PRECONDITION_REQUIRED, errorCode=IAM_CREDENTIAL_REQUIRED, args=myoceanbase,sys,ocp_monitor at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.run(AbstractShardingClusterTask.java:77) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.run(AbstractShardingClusterTask.java:47) at com.oceanbase.ocp.server.common.scheduled.ClusterSchedules.syncRootServer(ClusterSchedules.java:85) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.oceanbase.ocp.service.profile.exception.CredentialMissingException: [OCP CredentialMissingException]: status=428 PRECONDITION_REQUIRED, errorCode=IAM_CREDENTIAL_REQUIRED, args=myoceanbase,sys,ocp_monitor at com.oceanbase.ocp.service.profile.exception.CredentialMissingException.ob(CredentialMissingException.java:34) at com.oceanbase.ocp.service.credential.CredentialServiceImpl.acquireJdbcPasswordInner(CredentialServiceImpl.java:166) at com.oceanbase.ocp.service.credential.CredentialServiceImpl.acquireObPassword(CredentialServiceImpl.java:143) at com.oceanbase.ocp.service.credential.CredentialServiceImpl$$FastClassBySpringCGLIB$$6855c59e.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.service.credential.CredentialServiceImpl$$EnhancerBySpringCGLIB$$16fc940d.acquireObPassword() at com.oceanbase.ocp.service.ob.obsdk.factory.ConnectPropertiesBuilder.acquirePassword(ConnectPropertiesBuilder.java:204) at com.oceanbase.ocp.service.ob.obsdk.factory.ConnectPropertiesBuilder.buildConnectProperties(ConnectPropertiesBuilder.java:97) at com.oceanbase.ocp.service.ob.obsdk.factory.AbstractObOperatorFactory.buildConnectProperties(AbstractObOperatorFactory.java:324) at com.oceanbase.ocp.service.ob.obsdk.factory.AbstractObOperatorFactory.createObOperator(AbstractObOperatorFactory.java:117) at com.oceanbase.ocp.service.task.business.cluster.RefreshRsListTask.getRsList(RefreshRsListTask.java:90) at com.oceanbase.ocp.service.task.business.cluster.RefreshRsListTask.processCluster(RefreshRsListTask.java:42) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.lambda$run$1(AbstractShardingClusterTask.java:70) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted 2024-12-31 18:31:48.635 INFO 34018 --- [ocp-schedules-13,8645f9eff475f74e,f9438030a9fab659] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=0 2024-12-31 18:31:48.635 INFO 34018 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] cluster is not accessible, skip sync cluster, clusterId=1, status=TAKINGOVER 2024-12-31 18:31:48.635 INFO 34018 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=false, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:31:48.683 INFO 34018 --- [ocp-schedules-23,fee8c576c9bdfb1e,93ee1c5faa8b7702] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:31:48.683 INFO 34018 --- [ocp-schedules-23,fee8c576c9bdfb1e,93ee1c5faa8b7702] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:31:48.685 INFO 34018 --- [ocp-schedules-23,fee8c576c9bdfb1e,93ee1c5faa8b7702] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:31:48.685 INFO 34018 --- [ocp-schedules-23,fee8c576c9bdfb1e,93ee1c5faa8b7702] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:31:48.692 INFO 34018 --- [ocp-schedules-23,fee8c576c9bdfb1e,93ee1c5faa8b7702] c.o.ocp.monitor.service.IdKeyService : Sync record key and id, newRecordIdsCount=111, maxSyncedRecordId=730654274633891840 2024-12-31 18:31:48.693 INFO 34018 --- [ocp-schedules-23,fee8c576c9bdfb1e,93ee1c5faa8b7702] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:31:48.693 INFO 34018 --- [ocp-schedules-23,fee8c576c9bdfb1e,93ee1c5faa8b7702] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730654063467462656 2024-12-31 18:31:48.694 INFO 34018 --- [ocp-schedules-23,fee8c576c9bdfb1e,93ee1c5faa8b7702] c.o.ocp.monitor.service.IdKeyService : Sync record key and id, newRecordIdsCount=12, maxSyncedRecordId=730654315150868480 2024-12-31 18:31:48.735 ERROR 34018 --- [Sync all tenant information1,,] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.NotFoundException occurred with code error.ob.tenant.name.not.found, and args [myoceanbase, sys] 2024-12-31 18:31:48.737 ERROR 34018 --- [ocp-schedules-24,73fef8aa9e3c7683,80d7cbd365ad3cd6] .o.o.s.t.b.c.AbstractShardingClusterTask : process cluster error java.util.concurrent.ExecutionException: com.oceanbase.ocp.core.exception.NotFoundException: [OCP NotFoundException]: status=404 NOT_FOUND, errorCode=OB_TENANT_NAME_NOT_FOUND, args=myoceanbase,sys at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.run(AbstractShardingClusterTask.java:77) at com.oceanbase.ocp.server.common.scheduled.TenantSchedules.syncAllTenantInfo(TenantSchedules.java:43) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.oceanbase.ocp.core.exception.NotFoundException: [OCP NotFoundException]: status=404 NOT_FOUND, errorCode=OB_TENANT_NAME_NOT_FOUND, args=myoceanbase,sys at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at com.oceanbase.ocp.core.util.ExceptionUtils.newException(ExceptionUtils.java:96) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.lambda$getSysTenant$5(TenantDaoManagerImpl.java:171) at java.util.Optional.orElseThrow(Optional.java:290) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.getSysTenant(TenantDaoManagerImpl.java:171) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$a55dcec2.getSysTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantSyncServiceImpl.markSysTenantUnavailable(TenantSyncServiceImpl.java:271) at com.oceanbase.ocp.service.task.business.tenant.SyncAllTenantInfoShardingTask.processCluster(SyncAllTenantInfoShardingTask.java:38) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.lambda$run$1(AbstractShardingClusterTask.java:70) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted 2024-12-31 18:31:48.739 INFO 34018 --- [ocp-schedules-24,73fef8aa9e3c7683,80d7cbd365ad3cd6] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=0 2024-12-31 18:31:48.769 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:31:48.589287+08:00 2024-12-31 18:31:48.820 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.e.i.connector.ConnectorHolder : [ConnectorHolder]: connector put to cache, key=ConnectorKey(protocol=http, hostAddress=10.79.169.37, httpPort=62889, sshPort=null, authentication=Authentication(httpAuth=HttpAuthentication(authType=OCP-HMACSHA1, basicAuthConfig=null, digestAuthConfig=DigestAuthConfig(username=ocp_agent), formBaseAuthConfig=null, sslAuthConfig=null), sshAuth=null), proxy=null), estimated size:6 2024-12-31 18:31:48.820 INFO 34018 --- [ocp-schedules-25,2a8dc527151ce025,9ea63bd260f49951] c.o.o.e.i.connector.ConnectorHolder : [ConnectorHolder]: connector put to cache, key=ConnectorKey(protocol=http, hostAddress=10.79.169.38, httpPort=62889, sshPort=null, authentication=Authentication(httpAuth=HttpAuthentication(authType=OCP-HMACSHA1, basicAuthConfig=null, digestAuthConfig=DigestAuthConfig(username=ocp_agent), formBaseAuthConfig=null, sslAuthConfig=null), sshAuth=null), proxy=null), estimated size:6 2024-12-31 18:31:48.820 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.e.i.connector.ConnectorHolder : [ConnectorHolder]: connector put to cache, key=ConnectorKey(protocol=http, hostAddress=10.79.169.36, httpPort=62889, sshPort=null, authentication=Authentication(httpAuth=HttpAuthentication(authType=OCP-HMACSHA1, basicAuthConfig=null, digestAuthConfig=DigestAuthConfig(username=ocp_agent), formBaseAuthConfig=null, sslAuthConfig=null), sshAuth=null), proxy=null), estimated size:6 2024-12-31 18:31:48.820 INFO 34018 --- [ocp-schedules-25,2a8dc527151ce025,9ea63bd260f49951] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.38:62889/api/v1/log/alarms, params:null 2024-12-31 18:31:48.820 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.37:62889/api/v1/log/alarms, params:null 2024-12-31 18:31:48.820 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.36:62889/api/v1/log/alarms, params:null 2024-12-31 18:31:49.310 INFO 34018 --- [ocp-schedules-15,eaefd9ee34ea10c8,e6d930b94a13dac2] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:31:49.318 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:49.319 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:49.320 INFO 34018 --- [ocp-schedules-15,eaefd9ee34ea10c8,e6d930b94a13dac2] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:31:49.320 INFO 34018 --- [ocp-schedules-15,eaefd9ee34ea10c8,e6d930b94a13dac2] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:31:49.753 ERROR 34018 --- [ocp-schedules-25,2a8dc527151ce025,9ea63bd260f49951] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task java.lang.RuntimeException: java.lang.reflect.InvocationTargetException at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:79) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) ... 10 common frames omitted Caused by: com.oceanbase.ocp.executor.exception.HttpConnectFailedException: connect to agent failed, ConnectException: Connection refused (Connection refused) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.safeExecute(HttpTemplate.java:498) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.doGet(HttpTemplate.java:217) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.get(HttpTemplate.java:82) at com.oceanbase.ocp.executor.executor.MonitorExecutor.getAlarms(MonitorExecutor.java:51) at com.oceanbase.ocp.compute.agent.manager.HostAgentAlarmManagerImpl.getHostAgentAlarms(HostAgentAlarmManagerImpl.java:62) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl.getHostAgentAlarmsByHost(HostAgentServiceImpl.java:1086) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl$$FastClassBySpringCGLIB$$e7947c56.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl$$EnhancerBySpringCGLIB$$b664ab35.getHostAgentAlarmsByHost() at com.oceanbase.ocp.server.common.scheduled.HostSchedules.lambda$getHostAgentAlarms$1(HostSchedules.java:105) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:731) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Caused by: javax.ws.rs.ProcessingException: org.apache.http.conn.HttpHostConnectException: Connect to 10.79.169.36:62889 [/10.79.169.36] failed: Connection refused (Connection refused) at org.glassfish.jersey.apache.connector.ApacheConnector.apply(ApacheConnector.java:519) at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:297) at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$2(JerseyInvocation.java:687) at org.glassfish.jersey.client.JerseyInvocation.call(JerseyInvocation.java:697) at org.glassfish.jersey.client.JerseyInvocation.lambda$runInScope$3(JerseyInvocation.java:691) at org.glassfish.jersey.internal.Errors.process(Errors.java:292) at org.glassfish.jersey.internal.Errors.process(Errors.java:274) at org.glassfish.jersey.internal.Errors.process(Errors.java:205) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:390) at org.glassfish.jersey.client.JerseyInvocation.runInScope(JerseyInvocation.java:691) at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:686) at org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:432) at org.glassfish.jersey.client.JerseyInvocation$Builder.get(JerseyInvocation.java:323) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.lambda$doGet$0(HttpTemplate.java:217) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.safeExecute(HttpTemplate.java:489) ... 21 common frames omitted Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 10.79.169.36:62889 [/10.79.169.36] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:72) at org.glassfish.jersey.apache.connector.ApacheConnector.apply(ApacheConnector.java:471) ... 35 common frames omitted Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 44 common frames omitted 2024-12-31 18:31:50.090 INFO 34018 --- [ocp-schedules-5,64ee8a03ad5c46e6,d59ba877f7b75a8a] c.o.o.a.service.AlarmTargetServiceImpl : alarm targets changed, pre targets ,,,,,,, current targets ,,,,,C_myoceanbase-1735638920-PRIMARY,C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38,C_myoceanbase-1735638920/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38,H_10.79.169.36,H_10.79.169.37,H_10.79.169.38,H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:31:50.600 WARN 34018 --- [ocp-async-9,e890c4e7e8e79ee7,18ed2ef9de39f447] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:50.608 INFO 34018 --- [ocp-async-4,36521777e18a1841,a10e7b6c1fd54f07] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:51.568 INFO 34018 --- [prometheus-minute-schedule-1,55310aa832bd6163,71994f60b2c490fe] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:51.889 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:31:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:31:52.319 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:52.321 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:52.420 INFO 34018 --- [ocp-schedules-25,29deb5c039929f88,b13dc52c3aee1833] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:31:52.600 WARN 34018 --- [ocp-async-3,396dea3eec0447bd,4c217dab1e7afcd3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:52.608 INFO 34018 --- [ocp-async-7,ea46d6978a8a3741,139e02d0bd6a3142] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:53.857 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,2ccbe0064e779e45,437a553d4893fac7] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/tasks/instances/3/subtasks/37/logSegments?taskInstanceId=3&subtaskInstanceId=37, client=10.108.139.108, traceId=2ccbe0064e779e45, method=IterableResponse com.oceanbase.ocp.server.common.controller.TaskController.getSubtaskLogSegment(Long,Long), args=3,37,] 2024-12-31 18:31:53.864 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,2ccbe0064e779e45,437a553d4893fac7] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/tasks/instances/3/subtasks/37/logSegments client=10.108.139.108, traceId=2ccbe0064e779e45, duration=19 ms] 2024-12-31 18:31:54.568 INFO 34018 --- [prometheus-minute-schedule-1,24b126ace25faeb0,cb1ea704ae19833c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:54.600 WARN 34018 --- [ocp-async-5,c477035bf82451b5,3701655718f847d8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:54.608 INFO 34018 --- [ocp-async-10,2a287a6c48e07802,6860069867fbedc0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:55.321 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:55.323 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:56.005 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2024-12-31 18:31:56.005 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.ocp.core.property.PropertyService : Refresh config properties 2024-12-31 18:31:56.011 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:31:56.011 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:31:56.011 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:31:56.011 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:31:56.017 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:31:56.017 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:31:56.017 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:31:56.017 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:31:56.055 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:31:56.063 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:31:56.063 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:31:56.063 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:31:56.063 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:31:56.063 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:31:56.070 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:31:56.538 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2024-12-31 18:31:56.600 WARN 34018 --- [ocp-async-2,709370833593c4a8,af2c40cbaf496bf9] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:56.608 INFO 34018 --- [ocp-async-8,92a42b0c33271372,d05c6b878a42c7d7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:57.074 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT1.057316795S 2024-12-31 18:31:57.075 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:31:57.167 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2024-12-31 18:31:57.167 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2024-12-31 18:31:57.203 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 2024-12-31 18:31:57.279 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:31:57.279 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:31:57.279 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:31:57.279 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:31:57.279 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:31:57.280 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2024-12-31 18:31:57.290 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:31:57.442 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] o.s.boot.SpringApplication : Started application in 1.43 seconds (JVM running for 873.29) 2024-12-31 18:31:57.442 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT1.430910478S 2024-12-31 18:31:57.568 INFO 34018 --- [prometheus-minute-schedule-1,966b415672a9f77f,6754d9ebb3e64f8d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641120, interval=60 2024-12-31 18:31:57.887 INFO 34018 --- [ocp-schedules-19,38ced7194d2865fd,433b6a647ba7b422] c.o.ocp.core.property.PropertyService : Refresh config properties done 2024-12-31 18:31:58.323 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:31:58.325 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:31:58.466 INFO 34018 --- [ocp-schedules-21,9e8f3ee452720de6,d75cbd4f5294355f] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:31:58.468 INFO 34018 --- [ocp-schedules-30,08285678c6fba33e,c5305fde0cbb7fab] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2024-12-31 18:31:58.490 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.o.c.d.lock.jdbc.DefaultLockManager : Acquired distributed lock for key part-worker 2024-12-31 18:31:58.491 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Monitordb 2024-12-31 18:31:58.492 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.493 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:31:58.494 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.495 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.495 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.496 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_0 2024-12-31 18:31:58.505 INFO 34018 --- [ocp-async-4,694b5c0ca03f0542,96ec98eb312d2394] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:31:58.514 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.514 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.515 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.515 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_1 2024-12-31 18:31:58.531 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.531 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.531 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.532 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat_2 2024-12-31 18:31:58.540 INFO 34018 --- [ocp-schedules-26,0e4fad7297041512,25c65f80fb669a46] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:31:58.547 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.548 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.548 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.548 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_stat 2024-12-31 18:31:58.563 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.563 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.564 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.564 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sqltext 2024-12-31 18:31:58.569 INFO 34018 --- [ocp-schedules-16,73cc42da65c2a171,937f1d37090521e1] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:31:58.570 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.570 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.570 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.571 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_dynamic_sql 2024-12-31 18:31:58.575 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.575 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.576 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.576 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_high_risk_sql 2024-12-31 18:31:58.581 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.581 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.581 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.581 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_stat_0 2024-12-31 18:31:58.588 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.588 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.588 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.589 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan 2024-12-31 18:31:58.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:31:58.589027+08:00, lastProcessTime=2024-12-31T18:31:48.589287+08:00 2024-12-31 18:31:58.594 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.594 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.594 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.595 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_plan_cache_plan_explain 2024-12-31 18:31:58.600 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.600 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.600 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.600 WARN 34018 --- [ocp-async-7,59ff987985858d62,6c9c14f1cb88c39c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:31:58.601 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample 2024-12-31 18:31:58.608 INFO 34018 --- [ocp-async-5,499b38269c8d1561,c5fb633aa12c1b23] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:31:58.609 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.609 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.610 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.610 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_audit_sample_statistics 2024-12-31 18:31:58.624 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.625 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.625 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.625 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis_task 2024-12-31 18:31:58.631 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.631 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.631 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.632 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_perf_sql_diagnosis 2024-12-31 18:31:58.638 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.638 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.638 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.638 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_active_session_stat_0 2024-12-31 18:31:58.643 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.643 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.644 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.644 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_snapshot 2024-12-31 18:31:58.648 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.648 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.649 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.649 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cluster 2024-12-31 18:31:58.653 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.653 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.654 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.654 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_tenant 2024-12-31 18:31:58.658 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.658 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.659 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.659 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_server 2024-12-31 18:31:58.663 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.664 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.664 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.664 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_replica 2024-12-31 18:31:58.668 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.668 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.669 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.669 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sysstat 2024-12-31 18:31:58.673 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.673 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.674 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.674 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_row_lock 2024-12-31 18:31:58.678 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.678 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.679 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.679 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_latch 2024-12-31 18:31:58.683 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.683 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.684 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.684 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_cache 2024-12-31 18:31:58.688 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.689 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.689 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.689 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_parameter 2024-12-31 18:31:58.693 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.694 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.694 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.694 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_rpc 2024-12-31 18:31:58.699 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.699 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.699 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.700 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_packet 2024-12-31 18:31:58.704 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.704 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.704 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.705 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_clog 2024-12-31 18:31:58.709 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.709 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.709 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.710 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_location_cache 2024-12-31 18:31:58.713 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.714 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.714 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.714 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_gts 2024-12-31 18:31:58.718 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.718 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.719 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.719 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_system_event 2024-12-31 18:31:58.723 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.723 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.724 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.724 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_memory 2024-12-31 18:31:58.728 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.728 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.729 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.729 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_hit 2024-12-31 18:31:58.731 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:31:58.589027+08:00 2024-12-31 18:31:58.733 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.733 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.733 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.733 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_sql_plan_monitor 2024-12-31 18:31:58.740 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.741 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.741 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.741 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_trans_stat_v2 2024-12-31 18:31:58.747 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.747 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.748 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.748 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_system_event 2024-12-31 18:31:58.753 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.753 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.753 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.754 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_cluster_server_event 2024-12-31 18:31:58.759 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.759 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.760 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.760 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_1 2024-12-31 18:31:58.763 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.764 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.764 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.764 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_metric_data_60 2024-12-31 18:31:58.768 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.768 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.768 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.769 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_hour_data 2024-12-31 18:31:58.772 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.772 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.773 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.773 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_daily_data 2024-12-31 18:31:58.776 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.776 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.777 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.777 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_second 2024-12-31 18:31:58.786 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.786 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.787 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.787 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_minute 2024-12-31 18:31:58.809 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.809 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.810 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.810 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_hour 2024-12-31 18:31:58.816 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.817 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.817 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.817 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_daily 2024-12-31 18:31:58.823 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.824 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.824 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.824 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table metric_data_async 2024-12-31 18:31:58.830 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.830 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.830 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.831 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table sql_aggregate_data 2024-12-31 18:31:58.834 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.835 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.835 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.835 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_hist_partition_stats_compressed 2024-12-31 18:31:58.839 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.839 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.839 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.840 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ob_tenant_mini_compaction_info 2024-12-31 18:31:58.844 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Monitordb 2024-12-31 18:31:58.844 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.o.s.p.PartitionRolloverService : [OCP167006] Start watching scope, scope=Metadb 2024-12-31 18:31:58.844 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.845 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:31:58.846 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.846 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.846 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.846 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table profile_credential_sharing 2024-12-31 18:31:58.851 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.851 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select now() 2024-12-31 18:31:58.852 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:31:58.852 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: show create table ocp_cache_info 2024-12-31 18:31:58.856 INFO 34018 --- [ocp-schedules-29,30d4b5232e764be9,3151c12acf3cfc19] c.o.o.s.p.PartitionRolloverService : [OCP167007] Finish watching scope, scope=Metadb 2024-12-31 18:32:00.568 INFO 34018 --- [prometheus-minute-schedule-1,aa753519b129cf77,7141a41289d67da7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:00.601 WARN 34018 --- [ocp-async-10,2e7085600879bc9a,806f1aedc4a365eb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:00.609 INFO 34018 --- [ocp-async-2,29b0368fed2241ea,1d43cede64b53e5d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:01.325 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:01.327 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:02.465 INFO 34018 --- [ocp-schedules-30,df5b8e80eb86c79c,d7bc1a243372954f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:32:02.601 WARN 34018 --- [ocp-async-9,d869e30d990ca2e5,b60c0e69a64b4501] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:02.609 INFO 34018 --- [ocp-async-4,6a93f00e68f0d481,2681aae989dc06df] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:03.568 INFO 34018 --- [prometheus-minute-schedule-1,f998711d5f19dd61,46544a9a03c7d82c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:04.211 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:32:04.211 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:32:04.213 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2024-12-31 18:32:04.213 INFO 34018 --- [sql-rollup-daemon,,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'version_comment' 2024-12-31 18:32:04.214 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2024-12-31 18:32:04.266 WARN 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Skip cluster myoceanbase(1), status=TAKINGOVER 2024-12-31 18:32:04.266 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=52ms, period=120000ms 2024-12-31 18:32:04.327 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:04.329 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:04.601 WARN 34018 --- [ocp-async-6,9316b1d172dde365,d5ee4da99a5eed86] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:04.609 INFO 34018 --- [ocp-async-3,887dc08be5b7a8a8,838c8a5cae2c1822] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:06.568 INFO 34018 --- [prometheus-minute-schedule-1,70ad651379b655f3,a10c3a25ffb20f81] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:06.601 WARN 34018 --- [ocp-async-3,aa448762280d526f,c3c69bf03b086f9e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:06.609 INFO 34018 --- [ocp-async-10,21aaeabeb1cfc5b4,71ddc3d982cddaf2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:07.329 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:07.331 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:08.505 INFO 34018 --- [ocp-async-1,f458658e4590d612,9ae89a4e847e8ce8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:32:08.542 INFO 34018 --- [ocp-schedules-3,cab495defae7ca5b,cf2e1c64c8c70a4d] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:32:08.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:32:08.587859+08:00, lastProcessTime=2024-12-31T18:31:58.589027+08:00 2024-12-31 18:32:08.601 WARN 34018 --- [ocp-async-8,4970e1cf9905ad36,daa7a148ae132ead] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:08.609 INFO 34018 --- [ocp-async-2,fef999ed421c1727,b2ecc4e004675ee9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:08.751 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:32:08.587859+08:00 2024-12-31 18:32:09.324 INFO 34018 --- [ocp-schedules-29,3c3309533c4ce603,eacd252612f03b25] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:32:09.334 INFO 34018 --- [ocp-schedules-29,3c3309533c4ce603,eacd252612f03b25] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:32:09.334 INFO 34018 --- [ocp-schedules-29,3c3309533c4ce603,eacd252612f03b25] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:32:09.568 INFO 34018 --- [prometheus-minute-schedule-1,8ac22dc44eb95407,b1651290eb0c500d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:10.003 INFO 34018 --- [ocp-schedules-24,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:32:10.003 INFO 34018 --- [ocp-schedules-18,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:32:10.331 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:10.333 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:10.602 WARN 34018 --- [ocp-async-7,b49c52f9b549e444,f00b8604d97316d8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:10.609 INFO 34018 --- [ocp-async-4,9346f9037550096d,54e4790c9450256a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:10.920 WARN 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = ob_memory_percent,ob_tenant_cpu_percent,ob_tenant_disk_usage_v4, label = app=OB, gbLabel = app, ob_cluster_name, ob_cluster_id, tenant_name 2024-12-31 18:32:10.920 WARN 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = sql_all_count,sql_select_count,sql_insert_count,sql_update_count,sql_replace_count,sql_delete_count,sql_other_count,sql_all_rt,sql_select_rt,sql_insert_rt,sql_update_rt,sql_replace_rt,sql_delete_rt,sql_other_rt,sql_local_count,sql_remote_count,sql_distributed_count,sql_local_time,sql_remote_time,sql_distributed_time,active_session,all_session,wait_event_count,system_event_application_total_waits,system_event_configuration_total_waits,system_event_administrative_total_waits,system_event_concurrency_total_waits,system_event_commit_total_waits,system_event_network_total_waits,system_event_user_io_total_waits,system_event_system_io_total_waits,system_event_cluster_total_waits,system_event_other_total_waits,wait_event_rt,system_event_application_time_waited,system_event_configuration_time_waited,system_event_administrative_time_waited,system_event_concurrency_time_waited,system_event_commit_time_waited,system_event_network_time_waited,system_event_user_io_time_waited,system_event_system_io_time_waited,system_event_cluster_time_waited,system_event_other_time_waited,request_enqueue_count,request_dequeue_count,request_queue_time,ob_tenant_cpu_percent,ob_tenant_thread_percent,ob_memory_percent,memstore_percent,rpc_packet_in_rt,rpc_packet_out_rt,rpc_packet_in,rpc_packet_out,opened_cursors_count,max_full_clog_sync_delay_seconds,max_readonly_clog_sync_delay_seconds,max_logonly_clog_sync_delay_seconds,tps,transaction_commit_count,transaction_rollback_count,transaction_timeout_count,trans_sp_total_used_time,trans_distributed_total_used_time,tps_rt,transaction_commit_rt,transaction_rollback_rt,trans_commit_log_count,clog_trans_log_total_size,trans_commit_log_sync_rt,clog_write_disk_rt,memstore_write_lock_succ_count,memstore_write_lock_fail_count,memstore_write_lock_wait_time,transaction_single_partition_count,transaction_multi_partition_count,total_memstore_used,active_memstore_used,major_freeze_trigger,memstore_limit,io_read_count,io_write_count,io_read_rt,io_write_rt,io_read_size,io_writ 2024-12-31 18:32:10.920 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 1, ruleSize = 1. 2024-12-31 18:32:10.931 WARN 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = ob_memory_percent,ob_tenant_cpu_percent,ob_tenant_disk_usage_v4, label = app=OB, gbLabel = app, ob_cluster_name, ob_cluster_id, tenant_name 2024-12-31 18:32:10.931 WARN 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = sql_all_count,sql_select_count,sql_insert_count,sql_update_count,sql_replace_count,sql_delete_count,sql_other_count,sql_all_rt,sql_select_rt,sql_insert_rt,sql_update_rt,sql_replace_rt,sql_delete_rt,sql_other_rt,sql_local_count,sql_remote_count,sql_distributed_count,sql_local_time,sql_remote_time,sql_distributed_time,active_session,all_session,wait_event_count,system_event_application_total_waits,system_event_configuration_total_waits,system_event_administrative_total_waits,system_event_concurrency_total_waits,system_event_commit_total_waits,system_event_network_total_waits,system_event_user_io_total_waits,system_event_system_io_total_waits,system_event_cluster_total_waits,system_event_other_total_waits,wait_event_rt,system_event_application_time_waited,system_event_configuration_time_waited,system_event_administrative_time_waited,system_event_concurrency_time_waited,system_event_commit_time_waited,system_event_network_time_waited,system_event_user_io_time_waited,system_event_system_io_time_waited,system_event_cluster_time_waited,system_event_other_time_waited,request_enqueue_count,request_dequeue_count,request_queue_time,ob_tenant_cpu_percent,ob_tenant_thread_percent,ob_memory_percent,memstore_percent,rpc_packet_in_rt,rpc_packet_out_rt,rpc_packet_in,rpc_packet_out,opened_cursors_count,max_full_clog_sync_delay_seconds,max_readonly_clog_sync_delay_seconds,max_logonly_clog_sync_delay_seconds,tps,transaction_commit_count,transaction_rollback_count,transaction_timeout_count,trans_sp_total_used_time,trans_distributed_total_used_time,tps_rt,transaction_commit_rt,transaction_rollback_rt,trans_commit_log_count,clog_trans_log_total_size,trans_commit_log_sync_rt,clog_write_disk_rt,memstore_write_lock_succ_count,memstore_write_lock_fail_count,memstore_write_lock_wait_time,transaction_single_partition_count,transaction_multi_partition_count,total_memstore_used,active_memstore_used,major_freeze_trigger,memstore_limit,io_read_count,io_write_count,io_read_rt,io_write_rt,io_read_size,io_writ 2024-12-31 18:32:10.932 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 5, ruleSize = 5. 2024-12-31 18:32:12.523 INFO 34018 --- [ocp-schedules-7,4b4d5bb63648af8c,a4e0d240af8bb4ac] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:32:12.568 INFO 34018 --- [prometheus-minute-schedule-1,f86dacfb19b45774,8adf31b09b232d58] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:12.569 INFO 34018 --- [prometheus-hour-schedule-1,e43511f577e7d7d7,224f9d605230d533] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:32:12.602 WARN 34018 --- [ocp-async-4,a72cda9164782adf,c2201600fe0f662d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:12.609 INFO 34018 --- [ocp-async-10,6af318d92b9b604d,6eb6ecf528eb987d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:12.675 INFO 34018 --- [metric-archive-second-15,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641060, nodeCount=1, affectRows=1 2024-12-31 18:32:12.675 INFO 34018 --- [metric-archive-second-23,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641060, nodeCount=2, affectRows=2 2024-12-31 18:32:12.675 INFO 34018 --- [metric-archive-second-23,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641060, nodeCount=1, validCount=1 2024-12-31 18:32:12.675 INFO 34018 --- [metric-archive-second-15,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641060, nodeCount=1, validCount=1 2024-12-31 18:32:12.677 INFO 34018 --- [metric-archive-second-36,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641060, nodeCount=17, affectRows=17 2024-12-31 18:32:12.678 INFO 34018 --- [metric-archive-second-36,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641060, nodeCount=17, validCount=17 2024-12-31 18:32:12.680 INFO 34018 --- [metric-archive-second-18,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641060, nodeCount=179, affectRows=179 2024-12-31 18:32:12.680 INFO 34018 --- [metric-archive-second-18,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641060, nodeCount=178, validCount=178 2024-12-31 18:32:12.681 INFO 34018 --- [metric-archive-second-32,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641060, nodeCount=180, affectRows=180 2024-12-31 18:32:12.682 INFO 34018 --- [metric-archive-second-32,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641060, nodeCount=179, validCount=179 2024-12-31 18:32:13.333 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:13.335 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:14.602 WARN 34018 --- [ocp-async-8,1fb1164d9810f0f9,7be336a89b4f8ccf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:14.610 INFO 34018 --- [ocp-async-9,32b6b4d4a6c16892,64c4b5c42ec20e15] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:15.568 INFO 34018 --- [prometheus-minute-schedule-1,21e4c5ca4bd02bb6,8248f537d0e93de6] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:16.335 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:16.337 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:16.602 WARN 34018 --- [ocp-async-7,e7229780973975b6,781b0ae3e79fffa2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:16.610 INFO 34018 --- [ocp-async-2,00dc103c9f40e2ff,4650a1609a5ac1f7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:18.457 INFO 34018 --- [ocp-schedules-3,1e5b7656b349a94c,1950c8b5dd8fe96c] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:32:18.457 INFO 34018 --- [ocp-schedules-2,efa8362c1006245b,51b436782a822eb1] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:32:18.459 INFO 34018 --- [ocp-schedules-25,400d1eca318e6d48,9087fbc58e622ff9] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:32:18.464 INFO 34018 --- [ocp-schedules-2,efa8362c1006245b,51b436782a822eb1] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:32:18.464 INFO 34018 --- [ocp-schedules-3,1e5b7656b349a94c,1950c8b5dd8fe96c] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:32:18.467 INFO 34018 --- [ocp-schedules-1,8c56f8d817a9a12d,86b12f5d4d286233] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:32:18.467 INFO 34018 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : skip cluster not running and unavailable, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:32:18.472 INFO 34018 --- [ocp-schedules-24,c01b044d053d7698,92f93cf4acd2f04a] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:32:18.472 INFO 34018 --- [ocp-schedules-23,6ca7bd41ee0db597,a854b93e2d0aa2fc] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:32:18.472 INFO 34018 --- [ocp-schedules-24,c01b044d053d7698,92f93cf4acd2f04a] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:32:18.472 INFO 34018 --- [ocp-schedules-23,6ca7bd41ee0db597,a854b93e2d0aa2fc] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:32:18.472 INFO 34018 --- [ocp-schedules-30,f082194d82b09e8b,9a7cc28150a9e92d] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:32:18.472 INFO 34018 --- [ocp-schedules-30,f082194d82b09e8b,9a7cc28150a9e92d] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:32:18.505 INFO 34018 --- [ocp-async-2,4030d9a3e8b634d1,9300f7fdca1d74a6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:32:18.544 INFO 34018 --- [ocp-schedules-29,926c6a5c6f8ef0da,21eccbb85225531e] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:32:18.568 INFO 34018 --- [prometheus-minute-schedule-1,f07ec16403c4ad1d,0901500b5c4aa2d9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:18.585 INFO 34018 --- [ocp-schedules-27,27a4c71046eac83d,937a20a3a8792fc7] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:32:18.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:32:18.588581+08:00, lastProcessTime=2024-12-31T18:32:08.587859+08:00 2024-12-31 18:32:18.602 WARN 34018 --- [ocp-async-5,8939726b986a8080,426d54fa2b584f9b] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:18.610 INFO 34018 --- [ocp-async-1,09e03a468afb89b9,3e802f0840d35e10] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:18.636 INFO 34018 --- [ocp-schedules-8,73670257e3164b3c,3d82564292962193] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:32:18.636 INFO 34018 --- [ocp-schedules-8,0cffb74a76fe1ce6,4aad5b3f99870781] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:32:18.641 INFO 34018 --- [ocp-schedules-8,0cffb74a76fe1ce6,4aad5b3f99870781] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:32:18.689 INFO 34018 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] cluster is not accessible, skip sync cluster, clusterId=1, status=TAKINGOVER 2024-12-31 18:32:18.689 INFO 34018 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=false, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:32:18.748 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:32:18.588581+08:00 2024-12-31 18:32:19.337 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:19.339 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:20.602 WARN 34018 --- [ocp-async-10,8763c4c459e9500e,14426ea9d5acde50] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:20.610 INFO 34018 --- [ocp-async-9,7defb9d7b2b2fd9b,4119f96ebae6326f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:21.568 INFO 34018 --- [prometheus-minute-schedule-1,5bfc744e2eeb6980,dc5a5905d656b353] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:22.339 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:22.342 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:22.573 INFO 34018 --- [ocp-schedules-26,2f690c127ad28791,b9811be4985648aa] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:32:22.603 WARN 34018 --- [ocp-async-6,b10bc224b450bec6,71a4ed50baf3e698] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:22.610 INFO 34018 --- [ocp-async-2,05da78fd4fa6dac9,439dd53c12b4ace1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:24.568 INFO 34018 --- [prometheus-minute-schedule-1,271cb60b6a992276,6c37ad02ec27bc18] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:24.603 WARN 34018 --- [ocp-async-3,9a07b17062299a27,47ae6dbdf137ffdc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:24.611 INFO 34018 --- [ocp-async-4,6ed963d287537001,2fc6de700b30cfcb] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:25.342 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:25.344 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:26.603 WARN 34018 --- [ocp-async-1,0de4bbfaa3ef05cc,7e32ba53de75bac8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:26.611 INFO 34018 --- [ocp-async-8,ae19b58d63ae9c36,9be85fee8fb975c2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:27.568 INFO 34018 --- [prometheus-minute-schedule-1,9d5f8b78b2865812,21eb1c996045221d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:28.344 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:28.347 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:28.468 INFO 34018 --- [ocp-schedules-2,efa8362c1006245b,51b436782a822eb1] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2024-12-31 18:32:28.468 INFO 34018 --- [ocp-schedules-3,1e5b7656b349a94c,1950c8b5dd8fe96c] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:32:28.506 INFO 34018 --- [ocp-async-8,76f8d9ae10956ccb,298b2d993358f810] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:32:28.547 INFO 34018 --- [ocp-schedules-21,147fe1c2e9fc2ab6,cf822c11fc71f0cf] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:32:28.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:32:28.589718+08:00, lastProcessTime=2024-12-31T18:32:18.588581+08:00 2024-12-31 18:32:28.603 WARN 34018 --- [ocp-async-6,68b64d29dab7781d,bfaf7e8b905f3064] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:28.611 INFO 34018 --- [ocp-async-2,4cacf63dfc0c8f16,ad167345da221e80] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:28.759 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:32:28.589718+08:00 2024-12-31 18:32:29.338 INFO 34018 --- [ocp-schedules-23,4ab95f35f3c636bd,f11b316b0fdfcf40] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:32:29.348 INFO 34018 --- [ocp-schedules-23,4ab95f35f3c636bd,f11b316b0fdfcf40] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:32:29.348 INFO 34018 --- [ocp-schedules-23,4ab95f35f3c636bd,f11b316b0fdfcf40] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:32:30.568 INFO 34018 --- [prometheus-minute-schedule-1,8421e399a8d99ed6,c97cb6ddaecf9db8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:30.603 WARN 34018 --- [ocp-async-3,069d79f5a53c1e2e,0d80bb0612a2c3d0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:30.611 INFO 34018 --- [ocp-async-4,73ef9af41ee2bf14,c306be7efc7c37f2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:31.347 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:31.349 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:32.604 WARN 34018 --- [ocp-async-4,d4c1238314222ab5,73227199dcf900a5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:32.611 INFO 34018 --- [ocp-async-8,41bb7093014b5d9e,4d5b83ac8ed7b515] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:32.620 INFO 34018 --- [ocp-schedules-9,8f8ab835b90ee473,d5c8663da0404d65] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:32:33.568 INFO 34018 --- [prometheus-minute-schedule-1,5c1ddb3e258d2714,530938edd4778840] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:34.349 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:34.350 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:34.604 WARN 34018 --- [ocp-async-9,1d034e3fad57e9b1,acf43f0b4aeeeb96] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:34.611 INFO 34018 --- [ocp-async-7,e8192ba47d3a2a5b,8628100612eb6f71] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:36.568 INFO 34018 --- [prometheus-minute-schedule-1,6fe2950c88f81fb3,a243478c3e6bd6df] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:36.569 INFO 34018 --- [prometheus-cache-monitor1,8fac25a3d880582a,efd4eabc79aba9be] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1472,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":379,"seriesIdKeySize":379,"secondWriteQueue":0,"minuteWriteCacheSize":376} 2024-12-31 18:32:36.569 INFO 34018 --- [prometheus-cache-monitor1,8fac25a3d880582a,efd4eabc79aba9be] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=45, ob_cluster_status_check=7, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, ob_cluster_sync=6, http_server_requests_seconds_count=45, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:32:36.604 WARN 34018 --- [ocp-async-2,1c3b1edbab697580,c2216f362bf51080] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:36.612 INFO 34018 --- [ocp-async-5,01ee393871fad2a8,dd058a95c1a0da76] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:36.681 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2024-12-31T18:28:36.659, end=2024-12-31T18:30:36.678} 2024-12-31 18:32:36.694 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [] 2024-12-31 18:32:36.694 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2024-12-31 18:32:37.351 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:37.352 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:38.506 INFO 34018 --- [ocp-async-5,135b15b56d120d9a,90998be46e553e45] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:32:38.550 INFO 34018 --- [ocp-schedules-24,5c614ad2cc6abea4,703f61df8d6e4a5b] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:32:38.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:32:38.588397+08:00, lastProcessTime=2024-12-31T18:32:28.589718+08:00 2024-12-31 18:32:38.604 WARN 34018 --- [ocp-async-4,7dfcab7484668fb7,65473cec4cd77144] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:38.612 INFO 34018 --- [ocp-async-8,5ea8b31dca18aff7,b7c4cd30691a5eed] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:38.747 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:32:38.588397+08:00 2024-12-31 18:32:39.568 INFO 34018 --- [prometheus-minute-schedule-1,a82b1b1ed6effeda,aff2c074054bfdca] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:40.003 INFO 34018 --- [ocp-schedules-15,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:32:40.003 INFO 34018 --- [ocp-schedules-5,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:32:40.353 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:40.354 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:40.604 WARN 34018 --- [ocp-async-9,ad9fc31304fab011,66ce711b9d1f3544] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:40.613 INFO 34018 --- [ocp-async-7,fe08ebbd7ad8680f,b2b669ea185c9943] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:42.568 INFO 34018 --- [prometheus-minute-schedule-1,a7d44ab407d5f35a,472a41ce510145dd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:42.604 WARN 34018 --- [ocp-async-3,4863a4067ccaa83d,8b0bf55ff46fa858] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:42.613 INFO 34018 --- [ocp-async-5,c37ef07361c3a67f,5b8294104dfa6a5c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:42.666 INFO 34018 --- [ocp-schedules-27,80a3ccac1cf41400,37baafb460efb298] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:32:43.355 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:43.356 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:44.604 WARN 34018 --- [ocp-async-4,60c9f0bfede374f7,3eed338e38cc7dd2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:44.613 INFO 34018 --- [ocp-async-10,72d7ca6f080d227b,3331343ff2cc4b86] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:45.568 INFO 34018 --- [prometheus-minute-schedule-1,7b8204575504cf59,b16c725b22fc7295] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:46.357 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:46.358 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:46.605 WARN 34018 --- [ocp-async-8,9296fc6728395f19,18b95b0a599741c6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:46.613 INFO 34018 --- [ocp-async-6,a66e756fb1a8efc1,97d7c2f586a6ab10] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:48.456 INFO 34018 --- [ocp-schedules-29,ee0d5cf00cef3ae9,599dbe5ce33053da] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:32:48.457 INFO 34018 --- [ocp-schedules-15,3272ff3b585dfd32,5a5f33ce1fd8caa9] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:32:48.457 INFO 34018 --- [ocp-schedules-21,9e480c69aefb350e,bf602c037eb793ec] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:32:48.458 INFO 34018 --- [ocp-schedules-13,eeffa639f360a934,e5145394e5341749] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:32:48.459 INFO 34018 --- [ocp-schedules-12,a8063aeb7d314344,d5e8f42bf3768222] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:32:48.464 INFO 34018 --- [ocp-schedules-21,9e480c69aefb350e,bf602c037eb793ec] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:32:48.464 INFO 34018 --- [ocp-schedules-15,3272ff3b585dfd32,5a5f33ce1fd8caa9] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:32:48.464 INFO 34018 --- [ocp-schedules-29,ee0d5cf00cef3ae9,599dbe5ce33053da] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:32:48.464 INFO 34018 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : skip cluster not running and unavailable, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:32:48.465 INFO 34018 --- [ocp-schedules-14,4cc3ded6b52671e3,ae45a1b94d962f3a] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:32:48.467 INFO 34018 --- [ocp-schedules-13,eeffa639f360a934,e5145394e5341749] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:32:48.472 INFO 34018 --- [ocp-schedules-19,a7f91a113cebc92d,0b98d89018a1e1f6] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:32:48.472 INFO 34018 --- [ocp-schedules-18,ac356ba14b77f22e,f7bc331f153a4027] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:32:48.472 INFO 34018 --- [ocp-schedules-18,ac356ba14b77f22e,f7bc331f153a4027] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:32:48.472 INFO 34018 --- [ocp-schedules-19,a7f91a113cebc92d,0b98d89018a1e1f6] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:32:48.472 INFO 34018 --- [ocp-schedules-20,d912a40950a3a685,fbfee10291a8c302] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:32:48.472 INFO 34018 --- [ocp-schedules-20,d912a40950a3a685,fbfee10291a8c302] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:32:48.506 INFO 34018 --- [ocp-async-7,5084b486c59f4d33,91b2ced4ad292355] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:32:48.552 INFO 34018 --- [ocp-schedules-1,bb81a0e9dbdc8360,3a76ac4f95b21987] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:32:48.567 INFO 34018 --- [ocp-schedules-17,6bafbc1df281b415,e73c30535b19c75e] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:32:48.568 INFO 34018 --- [ocp-schedules-25,cfbdfc641b17f190,88e39fa434e0612a] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:32:48.568 INFO 34018 --- [ocp-schedules-25,cfbdfc641b17f190,88e39fa434e0612a] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:32:48.568 INFO 34018 --- [prometheus-minute-schedule-1,9cb7fd84448169f8,9f222fc527026441] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:48.588 INFO 34018 --- [ocp-schedules-24,fd8c5217a7897101,68e676b039acd72e] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:32:48.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:32:48.587877+08:00, lastProcessTime=2024-12-31T18:32:38.588397+08:00 2024-12-31 18:32:48.601 INFO 34018 --- [ocp-schedules-22,a3dab0911990695c,5e246c497064429c] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:32:48.601 INFO 34018 --- [ocp-schedules-22,a3dab0911990695c,5e246c497064429c] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:32:48.605 WARN 34018 --- [ocp-async-2,716a7c31b2935a6a,829c7e1cdb454819] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:48.613 INFO 34018 --- [ocp-async-1,dd366c479e2511fa,5572aa5105ba4672] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:48.617 INFO 34018 --- [ocp-schedules-18,8fe3970ba3df8f4e,aa20b39cd35ee3f4] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:32:48.617 INFO 34018 --- [ocp-schedules-14,2c2bd5ee7dbc5414,6573d751f29748a2] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2024-12-31 18:32:48.619 INFO 34018 --- [ocp-schedules-14,2c2bd5ee7dbc5414,6573d751f29748a2] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2024-12-31 18:32:48.624 INFO 34018 --- [ocp-schedules-18,8fe3970ba3df8f4e,aa20b39cd35ee3f4] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:32:48.624 INFO 34018 --- [ocp-schedules-18,8fe3970ba3df8f4e,aa20b39cd35ee3f4] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2024-12-31 18:32:48.643 INFO 34018 --- [ocp-schedules-22,a3dab0911990695c,5e246c497064429c] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:32:48.643 INFO 34018 --- [ocp-schedules-22,a3dab0911990695c,5e246c497064429c] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:32:48.650 INFO 34018 --- [ocp-schedules-2,7470830f6700f25f,c6d5a57b2d97f36d] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:32:48.668 INFO 34018 --- [ocp-schedules-20,c54b12bcf4dc057c,90a768dfe4e61bbe] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:32:48.668+08:00, clusters=[1] 2024-12-31 18:32:48.672 INFO 34018 --- [ocp-schedules-30,c10157af287fe373,9e789c81735ac3b7] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:32:48.672+08:00, clusters=[1] 2024-12-31 18:32:48.690 INFO 34018 --- [ocp-schedules-8,0cffb74a76fe1ce6,4aad5b3f99870781] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:32:48.690 INFO 34018 --- [ocp-schedules-8,20f9c07492eb815c,b7c3505d95adfbe8] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:32:48.694 INFO 34018 --- [ocp-schedules-8,20f9c07492eb815c,b7c3505d95adfbe8] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:32:48.695 INFO 34018 --- [ocp-schedules-5,0a0b279a39097cbd,e07264b2b95eb974] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:32:48.695 INFO 34018 --- [ocp-schedules-5,0a0b279a39097cbd,e07264b2b95eb974] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:32:48.702 INFO 34018 --- [ocp-schedules-5,0a0b279a39097cbd,e07264b2b95eb974] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:32:48.702 INFO 34018 --- [ocp-schedules-5,0a0b279a39097cbd,e07264b2b95eb974] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730654274633891840 2024-12-31 18:32:48.703 INFO 34018 --- [ocp-schedules-30,c10157af287fe373,9e789c81735ac3b7] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster myoceanbase for slowSqlStat, sql count is 0. 2024-12-31 18:32:48.707 INFO 34018 --- [ocp-schedules-5,0a0b279a39097cbd,e07264b2b95eb974] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:32:48.707 INFO 34018 --- [ocp-schedules-5,0a0b279a39097cbd,e07264b2b95eb974] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730654315150868480 2024-12-31 18:32:48.736 INFO 34018 --- [ocp-schedules-20,c54b12bcf4dc057c,90a768dfe4e61bbe] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster myoceanbase, trans stat result is empty. 2024-12-31 18:32:48.737 INFO 34018 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] cluster is not accessible, skip sync cluster, clusterId=1, status=TAKINGOVER 2024-12-31 18:32:48.737 INFO 34018 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=false, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:32:48.739 INFO 34018 --- [ocp-schedules-23,851394fb8edae0b2,d5d9fa60bbf85a64] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:32:48.743 INFO 34018 --- [ocp-schedules-23,851394fb8edae0b2,d5d9fa60bbf85a64] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:32:48.759 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:32:48.587877+08:00 2024-12-31 18:32:48.864 ERROR 34018 --- [Sync all tenant information1,,] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.NotFoundException occurred with code error.ob.tenant.name.not.found, and args [myoceanbase, sys] 2024-12-31 18:32:48.865 ERROR 34018 --- [ocp-schedules-23,851394fb8edae0b2,d5d9fa60bbf85a64] .o.o.s.t.b.c.AbstractShardingClusterTask : process cluster error java.util.concurrent.ExecutionException: com.oceanbase.ocp.core.exception.NotFoundException: [OCP NotFoundException]: status=404 NOT_FOUND, errorCode=OB_TENANT_NAME_NOT_FOUND, args=myoceanbase,sys at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.run(AbstractShardingClusterTask.java:77) at com.oceanbase.ocp.server.common.scheduled.TenantSchedules.syncAllTenantInfo(TenantSchedules.java:43) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.oceanbase.ocp.core.exception.NotFoundException: [OCP NotFoundException]: status=404 NOT_FOUND, errorCode=OB_TENANT_NAME_NOT_FOUND, args=myoceanbase,sys at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at com.oceanbase.ocp.core.util.ExceptionUtils.newException(ExceptionUtils.java:96) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.lambda$getSysTenant$5(TenantDaoManagerImpl.java:171) at java.util.Optional.orElseThrow(Optional.java:290) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.getSysTenant(TenantDaoManagerImpl.java:171) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$a55dcec2.getSysTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantSyncServiceImpl.markSysTenantUnavailable(TenantSyncServiceImpl.java:271) at com.oceanbase.ocp.service.task.business.tenant.SyncAllTenantInfoShardingTask.processCluster(SyncAllTenantInfoShardingTask.java:38) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.lambda$run$1(AbstractShardingClusterTask.java:70) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted 2024-12-31 18:32:48.865 INFO 34018 --- [ocp-schedules-23,851394fb8edae0b2,d5d9fa60bbf85a64] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=0 2024-12-31 18:32:49.352 INFO 34018 --- [ocp-schedules-17,990c88a98026cd35,6c776f9fcc5feb9c] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:32:49.359 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:49.360 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:49.361 INFO 34018 --- [ocp-schedules-17,990c88a98026cd35,6c776f9fcc5feb9c] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:32:49.361 INFO 34018 --- [ocp-schedules-17,990c88a98026cd35,6c776f9fcc5feb9c] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:32:49.766 INFO 34018 --- [ocp-schedules-18,d1a45d830392345b,8a51f8d015ac18f0] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[10.79.169.37, 10.79.169.38, 10.79.169.36] 2024-12-31 18:32:49.767 INFO 34018 --- [ocp-schedules-18,d1a45d830392345b,8a51f8d015ac18f0] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=2 2024-12-31 18:32:49.767 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=1 2024-12-31 18:32:49.767 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=3 2024-12-31 18:32:49.781 INFO 34018 --- [ocp-schedules-18,d1a45d830392345b,8a51f8d015ac18f0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:32:49.781 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:32:49.781 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:32:49.785 WARN 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:32:49.785 WARN 34018 --- [ocp-schedules-18,d1a45d830392345b,8a51f8d015ac18f0] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:32:49.785 INFO 34018 --- [ocp-schedules-18,d1a45d830392345b,8a51f8d015ac18f0] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:32:49.785 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:32:49.786 WARN 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:32:49.786 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:32:49.788 WARN 34018 --- [ocp-schedules-18,d1a45d830392345b,8a51f8d015ac18f0] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:32:49.788 WARN 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:32:49.789 WARN 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:32:49.796 INFO 34018 --- [ocp-schedules-18,d1a45d830392345b,8a51f8d015ac18f0] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.38:62889/api/v1/log/alarms, params:null 2024-12-31 18:32:49.796 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.36:62889/api/v1/log/alarms, params:null 2024-12-31 18:32:49.797 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.37:62889/api/v1/log/alarms, params:null 2024-12-31 18:32:49.811 ERROR 34018 --- [ocp-schedules-18,d1a45d830392345b,8a51f8d015ac18f0] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task java.lang.RuntimeException: java.lang.reflect.InvocationTargetException at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:79) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) ... 10 common frames omitted Caused by: com.oceanbase.ocp.executor.exception.HttpConnectFailedException: connect to agent failed, ConnectException: Connection refused (Connection refused) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.safeExecute(HttpTemplate.java:498) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.doGet(HttpTemplate.java:217) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.get(HttpTemplate.java:82) at com.oceanbase.ocp.executor.executor.MonitorExecutor.getAlarms(MonitorExecutor.java:51) at com.oceanbase.ocp.compute.agent.manager.HostAgentAlarmManagerImpl.getHostAgentAlarms(HostAgentAlarmManagerImpl.java:62) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl.getHostAgentAlarmsByHost(HostAgentServiceImpl.java:1086) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl$$FastClassBySpringCGLIB$$e7947c56.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl$$EnhancerBySpringCGLIB$$b664ab35.getHostAgentAlarmsByHost() at com.oceanbase.ocp.server.common.scheduled.HostSchedules.lambda$getHostAgentAlarms$1(HostSchedules.java:105) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:731) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Caused by: javax.ws.rs.ProcessingException: org.apache.http.conn.HttpHostConnectException: Connect to 10.79.169.36:62889 [/10.79.169.36] failed: Connection refused (Connection refused) at org.glassfish.jersey.apache.connector.ApacheConnector.apply(ApacheConnector.java:519) at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:297) at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$2(JerseyInvocation.java:687) at org.glassfish.jersey.client.JerseyInvocation.call(JerseyInvocation.java:697) at org.glassfish.jersey.client.JerseyInvocation.lambda$runInScope$3(JerseyInvocation.java:691) at org.glassfish.jersey.internal.Errors.process(Errors.java:292) at org.glassfish.jersey.internal.Errors.process(Errors.java:274) at org.glassfish.jersey.internal.Errors.process(Errors.java:205) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:390) at org.glassfish.jersey.client.JerseyInvocation.runInScope(JerseyInvocation.java:691) at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:686) at org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:432) at org.glassfish.jersey.client.JerseyInvocation$Builder.get(JerseyInvocation.java:323) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.lambda$doGet$0(HttpTemplate.java:217) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.safeExecute(HttpTemplate.java:489) ... 21 common frames omitted Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 10.79.169.36:62889 [/10.79.169.36] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:72) at org.glassfish.jersey.apache.connector.ApacheConnector.apply(ApacheConnector.java:471) ... 35 common frames omitted Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 44 common frames omitted 2024-12-31 18:32:50.046 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_merge_timeout, expression merge_timeout_flag == 1 2024-12-31 18:32:50.059 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_merge_timeout_flag', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY 2024-12-31 18:32:50.059 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_timeout 2024-12-31 18:32:50.059 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_merge_timeout 2024-12-31 18:32:50.059 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_traffic_drop, expression net_receive_drop_count > 100 2024-12-31 18:32:50.060 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_net_receive_drop_count', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.060 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_drop 2024-12-31 18:32:50.060 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_traffic_drop 2024-12-31 18:32:50.060 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_cannot_connect_arbitration, expression arbitration_status_inactive_server_count > 0 2024-12-31 18:32:50.061 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='arbitration_status_inactive_server_count', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY 2024-12-31 18:32:50.061 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_cannot_connect_arbitration 2024-12-31 18:32:50.061 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_server_cannot_connect_arbitration 2024-12-31 18:32:50.061 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_partition_leader_absent, expression tenant_partition_leader_absent_count > 100 2024-12-31 18:32:50.061 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_partition_leader_absent_count', labels={}}], alarmTargets 2024-12-31 18:32:50.061 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_partition_leader_absent 2024-12-31 18:32:50.061 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_partition_leader_absent 2024-12-31 18:32:50.061 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cpu_percent_over_threshold, expression ob_tenant_thread_percent > 80 2024-12-31 18:32:50.062 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cpu_percent', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.062 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cpu_percent_over_threshold 2024-12-31 18:32:50.062 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cpu_percent_over_threshold 2024-12-31 18:32:50.062 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_alarm_detect_timeout, expression ocp_alarm_detect_duration_seconds >= 3 2024-12-31 18:32:50.062 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_alarm_detect_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:32:50.062 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_alarm_detect_timeout 2024-12-31 18:32:50.062 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_alarm_detect_timeout 2024-12-31 18:32:50.062 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for backup_storage_capacity_retry_times_exceeded, expression storage_capacity_monitor_error_code == 1001 2024-12-31 18:32:50.063 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='storage_capacity_monitor_error_code', labels={}}], alarmTargets 2024-12-31 18:32:50.063 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_retry_times_exceeded 2024-12-31 18:32:50.063 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-backup_storage_capacity_retry_times_exceeded 2024-12-31 18:32:50.063 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_log_disk_percent_over_threshold, expression ob_log_disk_usage_percent > 95 2024-12-31 18:32:50.063 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_log_disk_percent_over_threshold, expression ob_log_disk_usage_percent > 92 2024-12-31 18:32:50.063 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_log_path_disk_percent', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.063 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_log_disk_percent_over_threshold 2024-12-31 18:32:50.063 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_log_disk_percent_over_threshold 2024-12-31 18:32:50.063 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_cpu_util_hwm, expression cpu_used_percent > 90 and cpu_steal < 20 2024-12-31 18:32:50.063 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_cpu_steal', labels={}}, Metric{name='host_cpu_used_percent', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.063 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_hwm 2024-12-31 18:32:50.063 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_cpu_util_hwm 2024-12-31 18:32:50.063 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_nic_1000m_hwm, expression eth_net_traffic_usage > 80 and eth_net_bandwidth_mbps < 300 and eth_net_bandwidth_mbps > 0 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='host_eth_net_traffic_usage', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_hwm 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_nic_1000m_hwm 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_cannot_connected, expression obproxy_connectable == 0 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_connectable', labels={}}], alarmTargets 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_cannot_connected 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_cannot_connected 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_recyclebin_disk_used_over_threshold, expression ob_database_disk_used_gb > 100 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_recyclebin_disk_used_gb', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_recyclebin_disk_used_over_threshold 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_recyclebin_disk_used_over_threshold 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_cannot_connect_to_leader, expression etcd_leader_connectable == 0 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_leader_connectable', labels={}}], alarmTargets 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_cannot_connect_to_leader 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_cannot_connect_to_leader 2024-12-31 18:32:50.064 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_net_send_percent_over_threshold, expression net_send_percent > 80 and eth_net_bandwidth_mbps > 0 2024-12-31 18:32:50.065 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='ob_host_net_send_percent', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.065 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_send_percent_over_threshold 2024-12-31 18:32:50.065 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_net_send_percent_over_threshold 2024-12-31 18:32:50.065 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_sda_ioawait, expression io_await >= 200 and io_util >= 99 2024-12-31 18:32:50.065 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_io_await', labels={}}, Metric{name='ob_host_io_util', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.065 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_sda_ioawait 2024-12-31 18:32:50.065 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_sda_ioawait 2024-12-31 18:32:50.065 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for refresh_location_cache_failed_by_metric, expression location_cache_log_count > 0 and location_cache_success_count == 0 and location_cache_sql_success_count == 0 2024-12-31 18:32:50.065 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_location_cache_log_count', labels={}}, Metric{name='ob_cluster_location_cache_success_count', labels={}}, Metric{name='ob_cluster_location_cache_sql_success_count', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.065 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=refresh_location_cache_failed_by_metric 2024-12-31 18:32:50.065 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-refresh_location_cache_failed_by_metric 2024-12-31 18:32:50.066 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_nvme_ioawait, expression io_await > 20 and io_util >= 98 and io_qusize >= 20 2024-12-31 18:32:50.066 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_io_qusize', labels={}}, Metric{name='ob_host_io_await', labels={}}, Metric{name='ob_host_io_util', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.066 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_nvme_ioawait 2024-12-31 18:32:50.066 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_nvme_ioawait 2024-12-31 18:32:50.066 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ic_server_connect_failed, expression ic_server_health == 0 2024-12-31 18:32:50.066 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ic_server_health', labels={}}], alarmTargets 2024-12-31 18:32:50.066 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ic_server_connect_failed 2024-12-31 18:32:50.066 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ic_server_connect_failed 2024-12-31 18:32:50.066 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_sync_failed, expression ob_cluster_sync == 0 2024-12-31 18:32:50.066 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_sync', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY 2024-12-31 18:32:50.066 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_failed 2024-12-31 18:32:50.066 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_sync_failed 2024-12-31 18:32:50.066 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_process_dead, expression oblb_process_exists == 0 or oblb_service_connectable == 0 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_process_exists', labels={}}, Metric{name='oblb_service_connectable', labels={}}], alarmTargets 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_process_dead 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_process_dead 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_traffic_error, expression net_traffic_err_count > 100 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_net_traffic_err_count', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_error 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_traffic_error 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_memstore_percent_over_threshold, expression memstore_percent > 95 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_memstore_percent_over_threshold, expression memstore_percent > 85 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_memstore_percent', labels={}}], alarmTargets 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_memstore_percent_over_threshold 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-tenant_memstore_percent_over_threshold 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_node_status_abnormal, expression binlog_node_available == 0 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_node_available', labels={}}], alarmTargets 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_node_status_abnormal 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_node_status_abnormal 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_nic_usage_over_threshold, expression oblb_net_traffic_usage > 80 and net_bandwidth_mbps > 0 2024-12-31 18:32:50.067 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_net_traffic_usage', labels={}}, Metric{name='net_bandwidth_mbps', labels={}}], alarmTargets 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_nic_usage_over_threshold 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_nic_usage_over_threshold 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_ip_forward_invalid, expression oblb_ip_forward_status != 1 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_ip_forward_status', labels={}}], alarmTargets 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_ip_forward_invalid 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_ip_forward_invalid 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for arbitration_service_unavailable, expression arbitration_service_available == 0 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='arbitration_service_available', labels={}}], alarmTargets 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=arbitration_service_unavailable 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-arbitration_service_unavailable 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_active_memstore_percent_over_threshold, expression active_memstore_percent > 110 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_active_memstore_percent', labels={}}], alarmTargets 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_active_memstore_percent_over_threshold 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-tenant_active_memstore_percent_over_threshold 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_service_conversion_delay, expression binlog_conversion_delay > 10000 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_conversion_delay', labels={}}], alarmTargets 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_service_conversion_delay 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_service_conversion_delay 2024-12-31 18:32:50.068 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obagent_dead, expression host_agent_process_status == 0 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_process_status', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obagent_dead 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obagent_dead 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_host_memory_usage_over_threshold, expression binlog_host_memory_usage > 90 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_host_memory_usage', labels={}}], alarmTargets 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_host_memory_usage_over_threshold 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_host_memory_usage_over_threshold 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for monagent_process_stop, expression monagent_boot_time_delta_seconds > 0 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='monagent_boot_time_delta_seconds', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=monagent_process_stop 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-monagent_process_stop 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for mgragent_process_stop, expression mgragent_boot_time_delta_seconds > 0 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='mgragent_boot_time_delta_seconds', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=mgragent_process_stop 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-mgragent_process_stop 2024-12-31 18:32:50.069 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_nic_1000m_full, expression eth_net_traffic_usage > 92 and eth_net_bandwidth_mbps < 300 and eth_net_bandwidth_mbps > 0 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='host_eth_net_traffic_usage', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_nic_1000m_full 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_nic_1000m_full 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_monitordb_disconnected, expression monitordb_connectable == 0 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='monitordb_connectable', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_monitordb_disconnected 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_monitordb_disconnected 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxyd_process_stop, expression obproxyd_boot_time_delta_seconds > 0 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxyd_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxyd_process_stop 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxyd_process_stop 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_host_storage_usage_over_threshold, expression binlog_host_storage_usage > 90 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_host_storage_usage', labels={}}], alarmTargets 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_host_storage_usage_over_threshold 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_host_storage_usage_over_threshold 2024-12-31 18:32:50.070 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant500_mem_hold_percent_over_threshold, expression tenant500_mem_hold_percent > 95 2024-12-31 18:32:50.071 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant500_mem_hold_percent', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.071 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_percent_over_threshold 2024-12-31 18:32:50.071 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant500_mem_hold_percent_over_threshold 2024-12-31 18:32:50.071 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for vpc_connect_failed, expression vpc_network_health == 0 2024-12-31 18:32:50.071 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='vpc_network_health', labels={}}], alarmTargets 2024-12-31 18:32:50.071 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=vpc_connect_failed 2024-12-31 18:32:50.071 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-vpc_connect_failed 2024-12-31 18:32:50.071 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_observer_fd_usage, expression observer_fd_usage > 65 and observer_fd_count > 0 2024-12-31 18:32:50.071 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_observer_fd_count', labels={}}, Metric{name='ob_host_observer_fd_usage', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.071 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_fd_usage 2024-12-31 18:32:50.071 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_observer_fd_usage 2024-12-31 18:32:50.071 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_sstable_percent_over_threshold, expression ob_disk_percent > 97 2024-12-31 18:32:50.071 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_sstable_percent_over_threshold, expression ob_disk_percent > 85 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_server_disk_percent', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_sstable_percent_over_threshold 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_server_sstable_percent_over_threshold 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_leader_absent, expression etcd_leader_count != 1 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_leader_count', labels={}}], alarmTargets 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_leader_absent 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_leader_absent 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant500_mem_hold_over_threshold, expression tenant500_mem_hold > 100 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant500_mem_hold_gigabyte', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_mem_hold_over_threshold 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant500_mem_hold_over_threshold 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_exists_expired_xa_trans, expression xa_trans_max_duration_seconds > 1200 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_xa_trans_max_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_exists_expired_xa_trans 2024-12-31 18:32:50.072 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_exists_expired_xa_trans 2024-12-31 18:32:50.073 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for agentd_process_stop, expression agentd_boot_time_delta_seconds > 0 2024-12-31 18:32:50.073 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='agentd_boot_time_delta_seconds', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.073 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=agentd_process_stop 2024-12-31 18:32:50.073 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-agentd_process_stop 2024-12-31 18:32:50.073 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_no_merge, expression no_merge_time > 108000 2024-12-31 18:32:50.073 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_no_merge_seconds', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY 2024-12-31 18:32:50.073 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_merge 2024-12-31 18:32:50.073 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_no_merge 2024-12-31 18:32:50.073 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_no_compaction, expression no_compaction_seconds > 108000 2024-12-31 18:32:50.073 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_no_compaction_seconds', labels={}}], alarmTargets 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_compaction 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_no_compaction 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_traffic_overload, expression eth_net_traffic_usage > 80 and eth_net_bandwidth_mbps > 0 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='host_eth_net_traffic_usage', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_traffic_overload 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_traffic_overload 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_mem_percent_over_threshold, expression memory_percent > 97 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_mem_percent_over_threshold, expression memory_percent > 95 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_mem_percent', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_mem_percent_over_threshold 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_mem_percent_over_threshold 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_connection_percent_over_threshold, expression ob_connection_percent > 80 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_connection_percent', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.074 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_connection_percent_over_threshold 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_connection_percent_over_threshold 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for observer_process_stop, expression observer_boot_time_delta_seconds > 0 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='observer_boot_time_delta_seconds', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=observer_process_stop 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-observer_process_stop 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_server_stopped, expression ob_server_stopped_duration_seconds > 0 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_stopped_duration_seconds', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_server_stopped 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_server_stopped 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for host_ntp_offset_too_large, expression ntp_offset_milliseconds > 100 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for host_ntp_offset_too_large, expression ntp_offset_milliseconds > 50 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_ntp_offset_milliseconds', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_offset_too_large 2024-12-31 18:32:50.075 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_ntp_offset_too_large 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for node_file_inode_usage, expression file_inode_usage > 80 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_file_inode_usage', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_inode_usage 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-node_file_inode_usage 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for standby_tenant_sync_delay_too_long, expression standby_tenant_delay_seconds >= 600 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='standby_tenant_delay_seconds', labels={}}], alarmTargets 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=standby_tenant_sync_delay_too_long 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-standby_tenant_sync_delay_too_long 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_expired_trans_exist, expression pending_trans_max_duration_seconds > 1200 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_pending_trans_max_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_expired_trans_exist 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_expired_trans_exist 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_large_trans_exist, expression trans_max_log_size_mb > 102400 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_trans_max_log_size_mb', labels={}}], alarmTargets 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_large_trans_exist 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_large_trans_exist 2024-12-31 18:32:50.076 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant500_storage_short_meta_mem_hold_high, expression tenant500_storage_short_meta_hold_percentage > 30 and tenant500_storage_short_meta_hold_gb > 0 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant500_storage_short_meta_hold_gb', labels={}}, Metric{name='tenant500_storage_short_meta_hold_percentage', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant500_storage_short_meta_mem_hold_high 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant500_storage_short_meta_mem_hold_high 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_cpu_util_full, expression cpu_used_percent >= 98 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_cpu_used_percent', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_util_full 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_cpu_util_full 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_leader_switched, expression etcd_leader_switch_count > 0 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_leader_switch_count', labels={}}], alarmTargets 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_leader_switched 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_leader_switched 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for host_ntp_service_not_exist, expression ntp_service_exist == 0 or ntp_service_available == 0 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_ntp_service_exist', labels={}}, Metric{name='host_ntp_service_available', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_ntp_service_not_exist 2024-12-31 18:32:50.077 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_ntp_service_not_exist 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for standby_tenant_sync_status_error, expression standby_tenant_restore_status_code == 2 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for standby_tenant_sync_status_error, expression standby_tenant_restore_status_code == 1 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='standby_tenant_restore_status_code', labels={}}], alarmTargets 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=standby_tenant_sync_status_error 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-standby_tenant_sync_status_error 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_task_timeout, expression ob_server_task_max_duration_seconds > 10800 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_task_max_duration', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_task_timeout 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_task_timeout 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_tsar_cpu_sys_abnormal, expression cpu_system > 40 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_cpu_system', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_tsar_cpu_sys_abnormal 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_tsar_cpu_sys_abnormal 2024-12-31 18:32:50.078 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_status_check_failed, expression ob_cluster_status_check == 0 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_status_check', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_status_check_failed 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_status_check_failed 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_invalid_disk_exists, expression ob_disk_invalid_count > 0 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_server_invalid_disk_count', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_invalid_disk_exists 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_invalid_disk_exists 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_keepalived_master_switched, expression keepalived_release_master_count > 0 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_keepalived_release_master_count', labels={}}], alarmTargets 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_keepalived_master_switched 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_keepalived_master_switched 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_exists_inactive_server, expression oblb_inactive_server_count > 0 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_inactive_server_count', labels={}}], alarmTargets 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_exists_inactive_server 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_exists_inactive_server 2024-12-31 18:32:50.079 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_tcp_retrans_percent_over_threshold, expression tcp_retrans_percent > 10 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_tcp_retrans_percent', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_tcp_retrans_percent_over_threshold 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_tcp_retrans_percent_over_threshold 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_cpu_percent_over_threshold, expression cpu_percent > 90 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_cpu_percent', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_cpu_percent_over_threshold 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_cpu_percent_over_threshold 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_process_dead, expression obdns_etcd_process_exists == 0 or obdns_etcd_connectable == 0 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_connectable', labels={}}, Metric{name='obdns_etcd_process_exists', labels={}}], alarmTargets 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_process_dead 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_process_dead 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_load1_per_cpu_over_threshold, expression load1_per_cpu > 2 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_load1_per_cpu_over_threshold, expression load1_per_cpu > 1.5 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_load1_per_cpu', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_load1_per_cpu_over_threshold 2024-12-31 18:32:50.080 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_load1_per_cpu_over_threshold 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_meta_db_disconnected, expression ocp_meta_db_health == 0 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_meta_db_health', labels={}}], alarmTargets 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_meta_db_disconnected 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_meta_db_disconnected 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_host_cpu_usage_over_threshold, expression binlog_host_cpu_usage > 90 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_host_cpu_usage', labels={}}], alarmTargets 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_host_cpu_usage_over_threshold 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_host_cpu_usage_over_threshold 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_http_request_too_many_errors_occur, expression ocp_http_request_error_count >= 1 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_http_request_error_count', labels={}}], alarmTargets 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_http_request_too_many_errors_occur 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_http_request_too_many_errors_occur 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_process_stop, expression obproxy_boot_time_delta_seconds > 0 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_boot_time_delta_seconds', labels={}}], alarmTargets 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_process_stop 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_process_stop 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_compaction_error, expression compaction_is_error == 1 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_compaction_error_flag', labels={}}], alarmTargets 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_compaction_error 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_compaction_error 2024-12-31 18:32:50.081 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_dump_error, expression binlog_dump_error_count > 10 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_dump_error_count', labels={}}], alarmTargets 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_dump_error 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_dump_error 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for host_disk_readonly, expression disk_readonly_flag == 1 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_disk_readonly_flag', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_disk_readonly 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_disk_readonly 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_sync_delay_time_too_long, expression sync_delay_time > 600 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_sync_delay_time', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_sync_delay_time_too_long 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_sync_delay_time_too_long 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_http_request_timeout, expression ocp_http_request_duration_seconds >= 5 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_http_request_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_http_request_timeout 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_http_request_timeout 2024-12-31 18:32:50.082 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for tenant_cpu_percent_over_threshold, expression ob_tenant_thread_percent > 80 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_cpu_percent', labels={}}], alarmTargets 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=tenant_cpu_percent_over_threshold 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-tenant_cpu_percent_over_threshold 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_keepalived_service_inactive, expression keepalived_process_exists == 0 or keepalived_up_status == 0 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_keepalived_up_status', labels={}}, Metric{name='oblb_keepalived_process_exists', labels={}}], alarmTargets 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_keepalived_service_inactive 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_keepalived_service_inactive 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_etcd_leader_absent, expression etcd_leader_count != 1 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_etcd_leader_count', labels={}}], alarmTargets 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_etcd_leader_absent 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_etcd_leader_absent 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_data_disk_percent_over_threshold, expression ob_data_disk_usage_percent > 97 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_data_path_disk_percent', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_data_disk_percent_over_threshold 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_data_disk_percent_over_threshold 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_keepalived_become_master, expression keepalived_become_master_count > 0 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_keepalived_become_master_count', labels={}}], alarmTargets 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_keepalived_become_master 2024-12-31 18:32:50.083 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_keepalived_become_master 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for host_process_cpu_bind_core_is_invalid, expression host_process_cpu_bind_core_alarm_status == 1 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_process_cpu_bind_core_alarm_status', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_process_cpu_bind_core_is_invalid 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_process_cpu_bind_core_is_invalid 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for agent_process_count_abnormal, expression agent_process_count != 1 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='agent_process_count', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=agent_process_count_abnormal 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-agent_process_count_abnormal 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_log_disk_usage_high, expression ob_tenant_log_disk_usage > 85 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_log_disk_usage', labels={}}], alarmTargets 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_log_disk_usage_high 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_log_disk_usage_high 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_service_name_is_invalid, expression ob_tenant_service_name_status == 1 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_service_name_status', labels={}}], alarmTargets 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_service_name_is_invalid 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_service_name_is_invalid 2024-12-31 18:32:50.084 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_service_instance_abnormal, expression binlog_instance_down > 0 2024-12-31 18:32:50.085 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_instance_down', labels={}}], alarmTargets 2024-12-31 18:32:50.085 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_service_instance_abnormal 2024-12-31 18:32:50.085 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_service_instance_abnormal 2024-12-31 18:32:50.085 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obdns_process_dead, expression obdns_process_exists == 0 or obdns_service_connectable == 0 2024-12-31 18:32:50.085 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obdns_service_connectable', labels={}}, Metric{name='obdns_process_exists', labels={}}], alarmTargets 2024-12-31 18:32:50.085 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obdns_process_dead 2024-12-31 18:32:50.085 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obdns_process_dead 2024-12-31 18:32:50.085 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_merge_error, expression merge_error_flag == 1 2024-12-31 18:32:50.085 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_merge_error_flag', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY 2024-12-31 18:32:50.085 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_merge_error 2024-12-31 18:32:50.085 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_merge_error 2024-12-31 18:32:50.086 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_observer_not_exist, expression observer_process_exists == 0 2024-12-31 18:32:50.086 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_observer_process_exists', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.086 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_not_exist 2024-12-31 18:32:50.086 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_observer_not_exist 2024-12-31 18:32:50.086 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for host_agent_open_fd_count_over_threshold, expression host_agent_open_fd_count > 1000 2024-12-31 18:32:50.086 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_open_fd_count', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.086 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_open_fd_count_over_threshold 2024-12-31 18:32:50.086 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_agent_open_fd_count_over_threshold 2024-12-31 18:32:50.086 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for backup_storage_capacity_timeout_or_interrupted, expression storage_capacity_monitor_error_code == 1002 2024-12-31 18:32:50.086 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='storage_capacity_monitor_error_code', labels={}}], alarmTargets 2024-12-31 18:32:50.086 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=backup_storage_capacity_timeout_or_interrupted 2024-12-31 18:32:50.086 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-backup_storage_capacity_timeout_or_interrupted 2024-12-31 18:32:50.086 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_net_recv_percent_over_threshold, expression net_recv_percent > 80 and eth_net_bandwidth_mbps > 0 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_eth_net_bandwidth_mbps', labels={}}, Metric{name='ob_host_net_recv_percent', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_net_recv_percent_over_threshold 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_net_recv_percent_over_threshold 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_cannot_connect_to_leader, expression etcd_leader_connectable == 0 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_leader_connectable', labels={}}], alarmTargets 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_cannot_connect_to_leader 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_cannot_connect_to_leader 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_collect_metric_failure_rate_high, expression collect_metric_failure_rate > 10 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ocp_collect_metric_failure_rate', labels={}}], alarmTargets 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_collect_metric_failure_rate_high 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_collect_metric_failure_rate_high 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_leader_switched, expression etcd_leader_switch_count > 0 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_leader_switch_count', labels={}}], alarmTargets 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_leader_switched 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_leader_switched 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxyd_process_dead, expression obproxyd_process_exists == 0 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxyd_process_exists', labels={}}], alarmTargets 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxyd_process_dead 2024-12-31 18:32:50.087 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxyd_process_dead 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_install_disk_percent_over_threshold, expression ob_install_disk_usage_percent > 97 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_install_disk_percent_over_threshold, expression ob_install_disk_usage_percent > 95 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_install_path_disk_percent', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_install_disk_percent_over_threshold 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_install_disk_percent_over_threshold 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_no_frozen, expression no_frozen_time > 90000 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_no_frozen_seconds', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_no_frozen 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_no_frozen 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_frozen_version_delta_over_threshold, expression frozen_versions > 1 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_frozen_version_delta', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_frozen_version_delta_over_threshold 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_frozen_version_delta_over_threshold 2024-12-31 18:32:50.088 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for binlog_service_disk_usage_over_threshold, expression binlog_service_disk_usage > 90 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='binlog_service_disk_usage', labels={}}], alarmTargets 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=binlog_service_disk_usage_over_threshold 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-binlog_service_disk_usage_over_threshold 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_core_dump, expression obproxy_core_dump_seconds < 1200 and obproxy_core_dump_seconds > 0 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_core_dump_seconds', labels={}}], alarmTargets 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_core_dump 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_core_dump 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_process_dead, expression obproxy_process_exists == 0 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_process_exists', labels={}}], alarmTargets 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_process_dead 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_process_dead 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for node_file_root_usage, expression root_disk_usage > 95 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_root_disk_usage', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=node_file_root_usage 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-node_file_root_usage 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_memory_peak, expression obproxy_rss_mem_used_percent > 90 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_rss_mem_used_percent', labels={}}], alarmTargets 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_memory_peak 2024-12-31 18:32:50.089 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_memory_peak 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_no_frozen, expression no_frozen_seconds > 90000 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_no_frozen_seconds', labels={}}], alarmTargets 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_no_frozen 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_no_frozen 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_observer_core_dump, expression observer_core_dump_seconds < 1200 and observer_core_dump_seconds > 0 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_observer_core_dump_seconds', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_observer_core_dump 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_observer_core_dump 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_partition_replica_absent, expression tenant_partition_replica_absent_count > 100 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_partition_replica_absent_count', labels={}}], alarmTargets 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_partition_replica_absent 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_partition_replica_absent 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for monitor_exporter_unavaliable, expression monitor_exporter_avaliable == 0 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='monitor_exporter_avaliable', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=monitor_exporter_unavaliable 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-monitor_exporter_unavaliable 2024-12-31 18:32:50.090 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for os_kernel_io_hang, expression io_util >= 99 and io_qusize >= 20 and io_read_write_time == 0 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_io_qusize', labels={}}, Metric{name='ob_host_io_util', labels={}}, Metric{name='ob_host_io_read_write_time', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=os_kernel_io_hang 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-os_kernel_io_hang 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for obproxy_client_connections_usage_over_threshold, expression client_connection_used_percent > 85 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='obproxy_client_connections_usage', labels={}}], alarmTargets 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=obproxy_client_connections_usage_over_threshold 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-obproxy_client_connections_usage_over_threshold 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_cpu_usage_over_threshold, expression ob_tenant_cpu_percent > 95 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_real_cpu_percent', labels={}}], alarmTargets 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_cpu_usage_over_threshold 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_cpu_usage_over_threshold 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for host_agent_res_memory_over_threshold, expression host_agent_resident_memory_gb > 1.5 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_res_memory', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_res_memory_over_threshold 2024-12-31 18:32:50.091 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_agent_res_memory_over_threshold 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for host_unavailable, expression host_available == 0 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_available', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_unavailable 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_unavailable 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_task_timeout, expression ob_tenant_task_max_duration_seconds > 10800 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_task_max_duration', labels={}}], alarmTargets 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_task_timeout 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_task_timeout 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_disk_readonly, expression disk_readonly_flag == 1 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_disk_readonly_flag', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_disk_readonly 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_disk_readonly 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_long_trans_exist, expression long_trans_max_duration_seconds > 1200 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_long_trans_max_duration_seconds', labels={}}], alarmTargets 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_long_trans_exist 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_long_trans_exist 2024-12-31 18:32:50.092 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_log_stream_degraded, expression ob_tenant_log_stream_degraded_count > 0 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_log_stream_degraded_count', labels={}}], alarmTargets 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_log_stream_degraded 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_log_stream_degraded 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for host_agent_goroutine_count_over_threshold, expression host_agent_goroutine_count > 3000 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_agent_goroutine_count', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=host_agent_goroutine_count_over_threshold 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-host_agent_goroutine_count_over_threshold 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cannot_connected, expression ob_connectable == 0 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_connectable', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cannot_connected 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cannot_connected 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for oblb_etcd_process_dead, expression etcd_process_exists == 0 or oblb_etcd_connectable == 0 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='oblb_etcd_connectable', labels={}}, Metric{name='oblb_etcd_process_exists', labels={}}], alarmTargets 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=oblb_etcd_process_dead 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-oblb_etcd_process_dead 2024-12-31 18:32:50.093 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_exists_inactive_server, expression inactive_server_count > 0 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_inactive_server_count', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_inactive_server 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_exists_inactive_server 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_host_partition_count_over_threshold, expression partition_count > 30000 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_host_partition_count', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY/H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_host_partition_count_over_threshold 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_host_partition_count_over_threshold 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ocp_remote_server_time_diff_too_large, expression clock_diff_milliseconds > 50 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='host_clock_diff_milliseconds', labels={}}], alarmTargets H_10.79.169.36,H_10.79.169.37,H_10.79.169.38 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ocp_remote_server_time_diff_too_large 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ocp_remote_server_time_diff_too_large 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_request_queue_over_threshold, expression ob_tenant_request_queue_size > 10 and request_queue_time > 1000 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_tenant_request_queue_over_threshold, expression ob_tenant_request_queue_size > 100 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_tenant_host_request_queue_time_us', labels={}}, Metric{name='ob_tenant_host_request_queue', labels={}}], alarmTargets 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_tenant_request_queue_over_threshold 2024-12-31 18:32:50.094 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_tenant_request_queue_over_threshold 2024-12-31 18:32:50.095 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : build for ob_cluster_exists_index_fail_table, expression index_fail_count > 0 2024-12-31 18:32:50.095 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : metricsForQuery [Metric{name='ob_cluster_index_fail_count', labels={}}], alarmTargets C_myoceanbase-1735638920-PRIMARY 2024-12-31 18:32:50.095 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.core.detect.AlarmRuleDetector : AlarmRuleDetector construct done, alarmType=ob_cluster_exists_index_fail_table 2024-12-31 18:32:50.095 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : create done, key=0-ob_cluster_exists_index_fail_table 2024-12-31 18:32:50.095 INFO 34018 --- [ocp-schedules-6,716501f9e02f70e7,3c5eba934e056497] c.o.o.a.u.f.VersionalProductFactory : refresh done, configCount=129, updatedCount=129, failedToUpdateCount=0 2024-12-31 18:32:50.605 WARN 34018 --- [ocp-async-1,50c58032a2a0ba7a,68097fbaaea3c873] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:50.613 INFO 34018 --- [ocp-async-6,402f32c88f36e666,b469b8ce2339f72b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:51.568 INFO 34018 --- [prometheus-minute-schedule-1,4ab1b8d6690112f4,d88010c60be7fcc5] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:51.889 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:32:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:32:52.360 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:52.362 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:52.605 WARN 34018 --- [ocp-async-6,132e3059a086ef40,4a7bbeaccf3e4a57] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:52.614 INFO 34018 --- [ocp-async-3,c38a66ac4398134c,8af7d2981f96f469] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:52.709 INFO 34018 --- [ocp-schedules-3,cb588c3d90131d3e,75d1a8f1fade1363] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:32:54.568 INFO 34018 --- [prometheus-minute-schedule-1,78b7a7ddea094ed8,1e1f6754139ad52f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:54.605 WARN 34018 --- [ocp-async-2,033866a3d368ebd2,17e5e721f4f0442a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:54.614 INFO 34018 --- [ocp-async-4,25d09df1e5bc90d4,5b8f7dc4cb13a9a2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:55.362 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:55.364 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:56.606 WARN 34018 --- [ocp-async-4,e8c3d9b63b49d344,cb107e946506100d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:56.614 INFO 34018 --- [ocp-async-8,9a2387c432f5ab7d,eafecfc300547f05] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:57.568 INFO 34018 --- [prometheus-minute-schedule-1,54098cf27404581e,d9f65bae96ccc307] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641180, interval=60 2024-12-31 18:32:58.364 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:32:58.366 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:32:58.465 INFO 34018 --- [ocp-schedules-21,9e480c69aefb350e,bf602c037eb793ec] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2024-12-31 18:32:58.465 INFO 34018 --- [ocp-schedules-15,3272ff3b585dfd32,5a5f33ce1fd8caa9] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:32:58.506 INFO 34018 --- [ocp-async-8,7fc2f948e47c257e,a287c8d0574743a8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:32:58.555 INFO 34018 --- [ocp-schedules-4,62f1534b80bacee8,f07f9a2a3f826e68] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:32:58.569 INFO 34018 --- [ocp-schedules-23,12de9bbb50f4faf9,55f7c41eca5fa56e] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:32:58.574 INFO 34018 --- [ocp-schedules-23,12de9bbb50f4faf9,55f7c41eca5fa56e] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:32:58.575 INFO 34018 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2024-12-31 18:32:58.591 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:32:58.590584+08:00, lastProcessTime=2024-12-31T18:32:48.587877+08:00 2024-12-31 18:32:58.606 WARN 34018 --- [ocp-async-10,d6e4b98392d280e0,76154359537b6d46] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:32:58.614 INFO 34018 --- [ocp-async-2,fb37ed805709c69c,61eea0f420ad5913] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:32:58.757 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:32:58.590584+08:00 2024-12-31 18:33:00.568 INFO 34018 --- [prometheus-minute-schedule-1,9d92a6e76bbf8cd9,09390bc99f2c4147] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:00.606 WARN 34018 --- [ocp-async-5,095943f53c9f5a16,6f64e3b5c85e2b81] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:00.614 INFO 34018 --- [ocp-async-4,1a69857f505f2765,08e0db11ffb28bb3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:01.366 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:01.368 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:02.606 WARN 34018 --- [ocp-async-9,33f28fa4e48b8555,2e5a6ded8ccedbd4] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:02.615 INFO 34018 --- [ocp-async-8,f3f8d5ee8e11cbf6,0790ccefbb4970e0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:02.842 INFO 34018 --- [ocp-schedules-5,811a7ca4a013223c,0b49b7e4419487c4] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:33:03.568 INFO 34018 --- [prometheus-minute-schedule-1,c9f5bfa36e695bf3,11b1576bbe88bbb7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:04.368 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:04.370 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:04.606 WARN 34018 --- [ocp-async-10,df4db5e4e1659405,b4959027290af2d2] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:04.615 INFO 34018 --- [ocp-async-7,5089e1bf009f20bc,755f3663cf2e9709] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:06.568 INFO 34018 --- [prometheus-minute-schedule-1,76ee695b9a3e0af7,a2f66d983be1c036] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:06.606 WARN 34018 --- [ocp-async-5,8c74aeb4297e148c,01a6a97d7c8a4a2d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:06.615 INFO 34018 --- [ocp-async-3,1ccba43cfd0a7721,4ada97efbd438ead] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:07.370 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:07.372 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:08.506 INFO 34018 --- [ocp-async-3,1e7dc2d4d5bd651b,330f782a8d6cfaf6] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:33:08.558 INFO 34018 --- [ocp-schedules-19,7105ab1b12c13914,96b21bea80a1df23] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:33:08.576 INFO 34018 --- [ocp-schedules-23,12de9bbb50f4faf9,55f7c41eca5fa56e] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:33:08.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:33:08.590022+08:00, lastProcessTime=2024-12-31T18:32:58.590584+08:00 2024-12-31 18:33:08.607 WARN 34018 --- [ocp-async-9,72ac1c8bb2833bd2,78e56ecadcd11d0e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:08.615 INFO 34018 --- [ocp-async-8,a358aa39fe0d7c78,9bf1d2e27a7a2e78] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:08.765 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:33:08.590022+08:00 2024-12-31 18:33:09.364 INFO 34018 --- [ocp-schedules-1,e026470e3b312f8e,321e87d4d0f55acc] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:33:09.374 INFO 34018 --- [ocp-schedules-1,e026470e3b312f8e,321e87d4d0f55acc] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:33:09.374 INFO 34018 --- [ocp-schedules-1,e026470e3b312f8e,321e87d4d0f55acc] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:33:09.568 INFO 34018 --- [prometheus-minute-schedule-1,89ae5a0900265439,23239a7222347c32] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:10.003 INFO 34018 --- [ocp-schedules-19,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:33:10.004 INFO 34018 --- [ocp-schedules-3,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:33:10.372 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:10.374 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:10.607 WARN 34018 --- [ocp-async-10,b69397ca6158ca37,e8f48b23d5714693] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:10.615 INFO 34018 --- [ocp-async-7,8dcd6f4408307ce2,818bb34da3ec720c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:10.916 WARN 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = ob_memory_percent,ob_tenant_cpu_percent,ob_tenant_disk_usage_v4, label = app=OB, gbLabel = app, ob_cluster_name, ob_cluster_id, tenant_name 2024-12-31 18:33:10.916 WARN 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = sql_all_count,sql_select_count,sql_insert_count,sql_update_count,sql_replace_count,sql_delete_count,sql_other_count,sql_all_rt,sql_select_rt,sql_insert_rt,sql_update_rt,sql_replace_rt,sql_delete_rt,sql_other_rt,sql_local_count,sql_remote_count,sql_distributed_count,sql_local_time,sql_remote_time,sql_distributed_time,active_session,all_session,wait_event_count,system_event_application_total_waits,system_event_configuration_total_waits,system_event_administrative_total_waits,system_event_concurrency_total_waits,system_event_commit_total_waits,system_event_network_total_waits,system_event_user_io_total_waits,system_event_system_io_total_waits,system_event_cluster_total_waits,system_event_other_total_waits,wait_event_rt,system_event_application_time_waited,system_event_configuration_time_waited,system_event_administrative_time_waited,system_event_concurrency_time_waited,system_event_commit_time_waited,system_event_network_time_waited,system_event_user_io_time_waited,system_event_system_io_time_waited,system_event_cluster_time_waited,system_event_other_time_waited,request_enqueue_count,request_dequeue_count,request_queue_time,ob_tenant_cpu_percent,ob_tenant_thread_percent,ob_memory_percent,memstore_percent,rpc_packet_in_rt,rpc_packet_out_rt,rpc_packet_in,rpc_packet_out,opened_cursors_count,max_full_clog_sync_delay_seconds,max_readonly_clog_sync_delay_seconds,max_logonly_clog_sync_delay_seconds,tps,transaction_commit_count,transaction_rollback_count,transaction_timeout_count,trans_sp_total_used_time,trans_distributed_total_used_time,tps_rt,transaction_commit_rt,transaction_rollback_rt,trans_commit_log_count,clog_trans_log_total_size,trans_commit_log_sync_rt,clog_write_disk_rt,memstore_write_lock_succ_count,memstore_write_lock_fail_count,memstore_write_lock_wait_time,transaction_single_partition_count,transaction_multi_partition_count,total_memstore_used,active_memstore_used,major_freeze_trigger,memstore_limit,io_read_count,io_write_count,io_read_rt,io_write_rt,io_read_size,io_writ 2024-12-31 18:33:10.917 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 1, ruleSize = 1. 2024-12-31 18:33:10.928 WARN 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = ob_memory_percent,ob_tenant_cpu_percent,ob_tenant_disk_usage_v4, label = app=OB, gbLabel = app, ob_cluster_name, ob_cluster_id, tenant_name 2024-12-31 18:33:10.928 WARN 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = sql_all_count,sql_select_count,sql_insert_count,sql_update_count,sql_replace_count,sql_delete_count,sql_other_count,sql_all_rt,sql_select_rt,sql_insert_rt,sql_update_rt,sql_replace_rt,sql_delete_rt,sql_other_rt,sql_local_count,sql_remote_count,sql_distributed_count,sql_local_time,sql_remote_time,sql_distributed_time,active_session,all_session,wait_event_count,system_event_application_total_waits,system_event_configuration_total_waits,system_event_administrative_total_waits,system_event_concurrency_total_waits,system_event_commit_total_waits,system_event_network_total_waits,system_event_user_io_total_waits,system_event_system_io_total_waits,system_event_cluster_total_waits,system_event_other_total_waits,wait_event_rt,system_event_application_time_waited,system_event_configuration_time_waited,system_event_administrative_time_waited,system_event_concurrency_time_waited,system_event_commit_time_waited,system_event_network_time_waited,system_event_user_io_time_waited,system_event_system_io_time_waited,system_event_cluster_time_waited,system_event_other_time_waited,request_enqueue_count,request_dequeue_count,request_queue_time,ob_tenant_cpu_percent,ob_tenant_thread_percent,ob_memory_percent,memstore_percent,rpc_packet_in_rt,rpc_packet_out_rt,rpc_packet_in,rpc_packet_out,opened_cursors_count,max_full_clog_sync_delay_seconds,max_readonly_clog_sync_delay_seconds,max_logonly_clog_sync_delay_seconds,tps,transaction_commit_count,transaction_rollback_count,transaction_timeout_count,trans_sp_total_used_time,trans_distributed_total_used_time,tps_rt,transaction_commit_rt,transaction_rollback_rt,trans_commit_log_count,clog_trans_log_total_size,trans_commit_log_sync_rt,clog_write_disk_rt,memstore_write_lock_succ_count,memstore_write_lock_fail_count,memstore_write_lock_wait_time,transaction_single_partition_count,transaction_multi_partition_count,total_memstore_used,active_memstore_used,major_freeze_trigger,memstore_limit,io_read_count,io_write_count,io_read_rt,io_write_rt,io_read_size,io_writ 2024-12-31 18:33:10.928 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 5, ruleSize = 5. 2024-12-31 18:33:12.568 INFO 34018 --- [prometheus-minute-schedule-1,3f81474f935863f2,c3428e20ebabcd2a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:12.569 INFO 34018 --- [prometheus-hour-schedule-1,d8907a12546662b0,b2e77bc956a011cb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:33:12.607 WARN 34018 --- [ocp-async-5,98145437f98f284c,c0962b992e8adfea] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:12.615 INFO 34018 --- [ocp-async-3,28c7213380b30d4b,632db52efd145976] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:12.684 INFO 34018 --- [metric-archive-second-36,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641120, nodeCount=78, affectRows=78 2024-12-31 18:33:12.685 INFO 34018 --- [metric-archive-second-36,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641120, nodeCount=78, validCount=78 2024-12-31 18:33:12.757 INFO 34018 --- [metric-archive-second-15,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641120, nodeCount=92, affectRows=92 2024-12-31 18:33:12.757 INFO 34018 --- [metric-archive-second-31,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641120, nodeCount=101, affectRows=101 2024-12-31 18:33:12.757 INFO 34018 --- [metric-archive-second-39,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641120, nodeCount=108, affectRows=108 2024-12-31 18:33:12.758 INFO 34018 --- [metric-archive-second-31,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641120, nodeCount=101, validCount=101 2024-12-31 18:33:12.758 INFO 34018 --- [metric-archive-second-15,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641120, nodeCount=91, validCount=91 2024-12-31 18:33:12.758 INFO 34018 --- [metric-archive-second-39,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641120, nodeCount=106, validCount=106 2024-12-31 18:33:12.892 INFO 34018 --- [ocp-schedules-6,21d372d169a8f770,9a6ecee507eac869] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:33:13.374 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:13.376 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:14.607 WARN 34018 --- [ocp-async-4,3f420a97a1787374,d770e7a4b818b1ef] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:14.616 INFO 34018 --- [ocp-async-1,c172c4f8d3d1055c,b6c0ac8152e8af42] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:15.568 INFO 34018 --- [prometheus-minute-schedule-1,e6c58f24ab13cf8a,66a674f40c328974] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:16.376 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:16.378 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:16.608 WARN 34018 --- [ocp-async-10,11825911bc027fd6,da38d03b5f70700d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:16.616 INFO 34018 --- [ocp-async-6,cbe0f754f67b9232,599fd2b0927d4efd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:18.457 INFO 34018 --- [ocp-schedules-7,4c5ed1c9c5f95712,c4be9f4c66730c5e] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:33:18.458 INFO 34018 --- [ocp-schedules-12,5233dc0a27228f70,b2ba250fed9241d7] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:33:18.458 INFO 34018 --- [ocp-schedules-1,bb5b4ee42b4d5f8c,1d8e2e1486c971eb] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:33:18.463 INFO 34018 --- [ocp-schedules-12,5233dc0a27228f70,b2ba250fed9241d7] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:33:18.464 INFO 34018 --- [ocp-schedules-7,4c5ed1c9c5f95712,c4be9f4c66730c5e] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:33:18.464 INFO 34018 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : skip cluster not running and unavailable, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:33:18.464 INFO 34018 --- [ocp-schedules-5,409234cec79742d6,f2dd88420cc8bf1f] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:33:18.471 INFO 34018 --- [ocp-schedules-30,5a72d65f98d96fa3,a1afbb7ee8ff530d] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:33:18.471 INFO 34018 --- [ocp-schedules-30,5a72d65f98d96fa3,a1afbb7ee8ff530d] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:33:18.472 INFO 34018 --- [ocp-schedules-27,7aa2f94c3d6778b5,1c8978b1af40ebf3] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:33:18.472 INFO 34018 --- [ocp-schedules-27,7aa2f94c3d6778b5,1c8978b1af40ebf3] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:33:18.472 INFO 34018 --- [ocp-schedules-6,214819c297863af2,df66faaec06ffdb6] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:33:18.472 INFO 34018 --- [ocp-schedules-6,214819c297863af2,df66faaec06ffdb6] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:33:18.507 INFO 34018 --- [ocp-async-6,9839685aab8efec3,c150972798db6334] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:33:18.561 INFO 34018 --- [ocp-schedules-20,7281ee5f14fe095b,e8985a8d7ef8953d] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:33:18.568 INFO 34018 --- [prometheus-minute-schedule-1,cc1be92409779968,5aa841dd3e0c9107] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:18.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:33:18.588969+08:00, lastProcessTime=2024-12-31T18:33:08.590022+08:00 2024-12-31 18:33:18.590 INFO 34018 --- [ocp-schedules-23,78093b3aac9ad74e,6ca3b3bb31bda29f] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:33:18.608 WARN 34018 --- [ocp-async-2,463701091cdce6ec,c7afacb966d5e4f7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:18.616 INFO 34018 --- [ocp-async-3,28fab870c3d068e6,4e30e215fa3dd57a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:18.737 INFO 34018 --- [ocp-schedules-8,20f9c07492eb815c,b7c3505d95adfbe8] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:33:18.737 INFO 34018 --- [ocp-schedules-8,6628d5372961355e,c31a388d8a289e11] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:33:18.743 INFO 34018 --- [ocp-schedules-8,6628d5372961355e,c31a388d8a289e11] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:33:18.775 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:33:18.588969+08:00 2024-12-31 18:33:18.791 INFO 34018 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] cluster is not accessible, skip sync cluster, clusterId=1, status=TAKINGOVER 2024-12-31 18:33:18.791 INFO 34018 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=false, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:33:19.378 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:19.379 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:20.085 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,c44f485e99cb4f49,c36feb83d1389c43] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?null, client=10.108.139.108, traceId=c44f485e99cb4f49, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObClusterController.listObClusters(String,List,boolean,Boolean,WithRemote,List,Pageable), args=false,NONE,Page request [number: 0, size 5000, sort: name: ASC,obClusterId: ASC],] 2024-12-31 18:33:20.088 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,9412a41ac8e17069,0168e429e860715d] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/tenants?null, client=10.108.139.108, traceId=9412a41ac8e17069, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObTenantController.listAllTenants(Pageable,String,List,Boolean,String,Boolean,List,WithRemoteTenant,List), args=Page request [number: 0, size 5000, sort: id: DESC],NONE,] 2024-12-31 18:33:20.092 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,e275629054a9f7c1,8f2ea6f46af8ad61] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/obproxy/clusters?null, client=10.108.139.108, traceId=e275629054a9f7c1, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObproxyController.listObproxyClusters(Pageable,List,String,List,Boolean), args=Page request [number: 0, size 5000, sort: id: ASC],false,] 2024-12-31 18:33:20.093 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,489a3a455a64093d,8a6ebf99117a6ff2] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/compute/hosts?null, client=10.108.139.108, traceId=489a3a455a64093d, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ComputeController.listHosts(List,String,List,List,List,List,List,List,List,List,Pageable), args=Page request [number: 0, size 5000, sort: id: DESC],] 2024-12-31 18:33:20.097 WARN 34018 --- [http-nio-0.0.0.0-8090-exec-4,489a3a455a64093d,8a6ebf99117a6ff2] o.h.h.internal.ast.QueryTranslatorImpl : HHH000104: firstResult/maxResults specified with collection fetch; applying in memory! 2024-12-31 18:33:20.108 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,c44f485e99cb4f49,c36feb83d1389c43] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=10.108.139.108, traceId=c44f485e99cb4f49, duration=33 ms] 2024-12-31 18:33:20.140 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,9412a41ac8e17069,0168e429e860715d] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/tenants client=10.108.139.108, traceId=9412a41ac8e17069, duration=64 ms] 2024-12-31 18:33:20.141 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,e275629054a9f7c1,8f2ea6f46af8ad61] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/obproxy/clusters client=10.108.139.108, traceId=e275629054a9f7c1, duration=57 ms] 2024-12-31 18:33:20.156 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,489a3a455a64093d,8a6ebf99117a6ff2] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/compute/hosts client=10.108.139.108, traceId=489a3a455a64093d, duration=69 ms] 2024-12-31 18:33:20.608 WARN 34018 --- [ocp-async-4,69b62530bdb14f92,f82ef10499d3b187] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:20.616 INFO 34018 --- [ocp-async-1,db7b097b049788b8,474967f6a9ee80c7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:21.568 INFO 34018 --- [prometheus-minute-schedule-1,8cce1dc9f9bb6f86,158af0edff4f26be] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:22.133 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,516814cc68334fa0,bfc3d6123dde4221] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/alarm/groups?null, client=10.108.139.108, traceId=516814cc68334fa0, method=ResponseEntity com.oceanbase.ocp.server.common.controller.AlarmController.fetchAlarmGroups(Integer,Integer), args=] 2024-12-31 18:33:22.134 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,f22715fbdd4bcf16,d6a02ab101181f96] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/alarm/templates?null, client=10.108.139.108, traceId=f22715fbdd4bcf16, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.AlarmController.getAlarmTemplates(String,String,Boolean,Boolean,Pageable), args=Page request [number: 0, size 5000, sort: id: DESC],] 2024-12-31 18:33:22.135 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,2b159d898c268eec,5a0a0481454dd957] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/tenants?null, client=10.108.139.108, traceId=2b159d898c268eec, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObTenantController.listAllTenants(Pageable,String,List,Boolean,String,Boolean,List,WithRemoteTenant,List), args=Page request [number: 0, size 5000, sort: id: DESC],NONE,] 2024-12-31 18:33:22.142 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,2b159d898c268eec,5a0a0481454dd957] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/tenants client=10.108.139.108, traceId=2b159d898c268eec, duration=17 ms] 2024-12-31 18:33:22.171 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,f22715fbdd4bcf16,d6a02ab101181f96] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/templates client=10.108.139.108, traceId=f22715fbdd4bcf16, duration=44 ms] 2024-12-31 18:33:22.191 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,516814cc68334fa0,bfc3d6123dde4221] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/groups client=10.108.139.108, traceId=516814cc68334fa0, duration=62 ms] 2024-12-31 18:33:22.306 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,,] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /error?null, client=10.108.139.108, traceId=, method=ModelAndView com.oceanbase.ocp.server.common.controller.web.CustomErrorController.handleError(HttpServletRequest), args=] 2024-12-31 18:33:22.306 WARN 34018 --- [http-nio-0.0.0.0-8090-exec-7,,] c.o.o.s.c.c.web.CustomErrorController : Requested URL not found: [url=/api/v2/arbitration/services, method=10.108.139.108, client=GET, traceId=] 2024-12-31 18:33:22.306 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,,] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /error client=10.108.139.108, traceId=, duration=0 ms] 2024-12-31 18:33:22.379 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:22.381 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:22.608 WARN 34018 --- [ocp-async-10,50f2ab1e25b85263,e7f5d8149b274535] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:22.616 INFO 34018 --- [ocp-async-6,0634d250d269a839,9698af4b77255eb7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:22.831 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,ddeb720e09802894,909e213115066241] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/alarm/alarms/actived?page=1&size=10&collapsed=false, client=10.108.139.108, traceId=ddeb720e09802894, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.AlarmController.fetchActivedAlarms(String,String,List,String,List,List,List,OffsetDateTime,OffsetDateTime,String,Pageable), args=Page request [number: 0, size 10, sort: id: DESC],] 2024-12-31 18:33:22.964 INFO 34018 --- [ocp-schedules-29,9ca87369c0fd6ea5,c1f4df82bc215680] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:33:22.975 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,ddeb720e09802894,909e213115066241] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/alarm/alarms/actived client=10.108.139.108, traceId=ddeb720e09802894, duration=151 ms] 2024-12-31 18:33:24.568 INFO 34018 --- [prometheus-minute-schedule-1,10116f5294eddc7f,068b85918483b84e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:24.608 WARN 34018 --- [ocp-async-7,5608ee68364360de,b26fa626a7027de6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:24.617 INFO 34018 --- [ocp-async-5,c77b16e5078847f0,a2426deeb94c892b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:25.381 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:25.383 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:26.608 WARN 34018 --- [ocp-async-3,11d8a5d081a9375a,a91671ff57b32081] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:26.617 INFO 34018 --- [ocp-async-9,26fd10f9161f7af0,cdb0e462122e1210] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:27.568 INFO 34018 --- [prometheus-minute-schedule-1,f26ff3d33cff7524,960500150ad78348] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:28.383 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:28.385 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:28.464 INFO 34018 --- [ocp-schedules-12,5233dc0a27228f70,b2ba250fed9241d7] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2024-12-31 18:33:28.464 INFO 34018 --- [ocp-schedules-7,4c5ed1c9c5f95712,c4be9f4c66730c5e] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:33:28.507 INFO 34018 --- [ocp-async-9,0e4c9f235cb8b1e4,e5a9a495655ead46] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:33:28.563 INFO 34018 --- [ocp-schedules-6,6e4b20f318d4c34b,84fe0a1625a1596a] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:33:28.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:33:28.588294+08:00, lastProcessTime=2024-12-31T18:33:18.588969+08:00 2024-12-31 18:33:28.608 WARN 34018 --- [ocp-async-10,fae0c0d245834444,384c769bbbca90b8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:28.617 INFO 34018 --- [ocp-async-6,a604a93348cb94d7,9ab4df0f20f2f4e0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:28.759 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:33:28.588294+08:00 2024-12-31 18:33:29.377 INFO 34018 --- [ocp-schedules-30,dc9631e140073957,becb42b82e079f59] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:33:29.428 INFO 34018 --- [ocp-schedules-30,dc9631e140073957,becb42b82e079f59] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:33:29.428 INFO 34018 --- [ocp-schedules-30,dc9631e140073957,becb42b82e079f59] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:33:30.568 INFO 34018 --- [prometheus-minute-schedule-1,f5d248fa464d8496,0d459360f00ba876] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:30.609 WARN 34018 --- [ocp-async-7,1c1487a9b8ada53f,a1d239b54e3c2698] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:30.617 INFO 34018 --- [ocp-async-5,f40d3f6c5a0d21cc,4f843df9054a0749] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:31.385 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:31.387 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:32.609 WARN 34018 --- [ocp-async-3,4ae33c03dbe6832a,025484ab816d59f7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:32.617 INFO 34018 --- [ocp-async-9,07d43dcd0d26ff5a,d24cf77bebe8281c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:33.004 INFO 34018 --- [ocp-schedules-13,a479bdc811f4ec6c,baf7ecae106a4b60] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:33:33.568 INFO 34018 --- [prometheus-minute-schedule-1,2d21b992007bd976,34a6830c34092f26] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:34.387 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:34.389 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:34.609 WARN 34018 --- [ocp-async-9,dce910d7a7eb9973,8470766c887132c6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:34.617 INFO 34018 --- [ocp-async-8,0f26aaed5c1d2606,8c66d1a5a770aa70] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:36.568 INFO 34018 --- [prometheus-minute-schedule-1,ee5dba46b3bd0bd0,1e644eb2860ed2a9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:36.569 INFO 34018 --- [prometheus-cache-monitor1,ea8db567a2a566c0,8753536c1b672d86] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1494,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":383,"seriesIdKeySize":383,"secondWriteQueue":0,"minuteWriteCacheSize":376} 2024-12-31 18:33:36.570 INFO 34018 --- [prometheus-cache-monitor1,ea8db567a2a566c0,8753536c1b672d86] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=47, ob_cluster_status_check=7, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, ob_cluster_sync=6, http_server_requests_seconds_count=47, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:33:36.609 WARN 34018 --- [ocp-async-8,752527000cd0de33,9db0eaba8d23d10e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:36.618 INFO 34018 --- [ocp-async-2,487c8f22f77cffd1,969342db52243188] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:37.389 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:37.391 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:38.507 INFO 34018 --- [ocp-async-6,aba28728ea0838bf,4dbf3e45daab7069] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:33:38.566 INFO 34018 --- [ocp-schedules-24,5e44d0be53023066,dddabe20943691cc] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:33:38.591 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:33:38.590068+08:00, lastProcessTime=2024-12-31T18:33:28.588294+08:00 2024-12-31 18:33:38.610 WARN 34018 --- [ocp-async-5,09b0c062b2f7f9bf,3f329df6942111d7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:38.618 INFO 34018 --- [ocp-async-4,8447072f7b8c2783,908c7903dc8624b9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:38.758 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:33:38.590068+08:00 2024-12-31 18:33:39.568 INFO 34018 --- [prometheus-minute-schedule-1,bf2bf05a718ac1eb,e778915f495f4b4d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:40.004 INFO 34018 --- [ocp-schedules-2,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:33:40.004 INFO 34018 --- [ocp-schedules-23,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:33:40.391 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:40.393 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:40.610 WARN 34018 --- [ocp-async-4,6b8659f9b0bd34eb,1b754cb85add267a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:40.618 INFO 34018 --- [ocp-async-10,02fa464d0bc186ca,012bb4cc06d88583] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:42.568 INFO 34018 --- [prometheus-minute-schedule-1,74169c7ffbc14fe4,cc04c477d9c0a251] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:42.610 WARN 34018 --- [ocp-async-10,3b52c891b4a18204,132c3abbb68387ca] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:42.618 INFO 34018 --- [ocp-async-2,7e8d4f8a638551ef,3726ae5185df8174] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:43.074 INFO 34018 --- [ocp-schedules-29,24859ed206e44698,b05ee3a3881fb976] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:33:43.393 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:43.395 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:44.610 WARN 34018 --- [ocp-async-2,d09d4e1addae7687,3af40ea890581ddb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:44.618 INFO 34018 --- [ocp-async-9,f00475b70070f6d2,c7862a3fc918c0e3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:45.568 INFO 34018 --- [prometheus-minute-schedule-1,f97f5febc1cf6afb,581cf7fa8c6cb364] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:46.395 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:46.396 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:46.610 WARN 34018 --- [ocp-async-9,5167184903f003a6,72795d06f0a63f3e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:46.619 INFO 34018 --- [ocp-async-8,c7e4301a1981db37,e452e7f66a7c5cc9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:48.456 INFO 34018 --- [ocp-schedules-1,3b6e629deb8a4072,6c7251215b83274f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:33:48.457 INFO 34018 --- [ocp-schedules-25,0e68cb7dfb2e4a23,ba59a4228a90a542] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:33:48.458 INFO 34018 --- [ocp-schedules-15,d375b72c1787954f,839086f47dc03d4a] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:33:48.458 INFO 34018 --- [ocp-schedules-16,1e13f9dd8bdddcd0,a9e7664498a4a471] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:33:48.459 INFO 34018 --- [ocp-schedules-6,ea33a53ac39ddf8e,99ce0d2bb3385f34] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:33:48.463 INFO 34018 --- [ocp-schedules-1,3b6e629deb8a4072,6c7251215b83274f] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:33:48.464 INFO 34018 --- [ocp-schedules-25,0e68cb7dfb2e4a23,ba59a4228a90a542] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:33:48.464 INFO 34018 --- [ocp-schedules-15,d375b72c1787954f,839086f47dc03d4a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:33:48.464 INFO 34018 --- [ocp-schedules-7,b4d2aafdad2aa3db,7c051fb788fed544] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:33:48.465 INFO 34018 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : skip cluster not running and unavailable, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:33:48.467 INFO 34018 --- [ocp-schedules-16,1e13f9dd8bdddcd0,a9e7664498a4a471] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:33:48.472 INFO 34018 --- [ocp-schedules-10,f855ee3d9b20f555,4eb24780232bbc4d] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:33:48.473 INFO 34018 --- [ocp-schedules-2,55221663d4309c0a,1d193f7428e442a8] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:33:48.473 INFO 34018 --- [ocp-schedules-10,f855ee3d9b20f555,4eb24780232bbc4d] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:33:48.473 INFO 34018 --- [ocp-schedules-2,55221663d4309c0a,1d193f7428e442a8] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:33:48.473 INFO 34018 --- [ocp-schedules-26,c7835fa96e614632,69db86a21abf00cc] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:33:48.473 INFO 34018 --- [ocp-schedules-26,c7835fa96e614632,69db86a21abf00cc] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:33:48.507 INFO 34018 --- [ocp-async-10,614f87db2567276f,6330983912dd3a82] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:33:48.516 INFO 34018 --- [ocp-schedules-19,68110161eabf285c,817519adf262cb8e] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1494,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":387,"seriesIdKeySize":387,"secondWriteQueue":0,"minuteWriteCacheSize":376} 2024-12-31 18:33:48.516 INFO 34018 --- [ocp-schedules-19,68110161eabf285c,817519adf262cb8e] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=49, ob_cluster_status_check=7, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, ob_cluster_sync=6, http_server_requests_seconds_count=49, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:33:48.566 INFO 34018 --- [ocp-schedules-14,784d3ba3ed2ce183,da38a77f26c4fe21] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: hostQueryCache 2024-12-31 18:33:48.566 INFO 34018 --- [ocp-schedules-14,784d3ba3ed2ce183,da38a77f26c4fe21] c.o.o.core.cache.helper.HostQueryCache : Init host cache. 2024-12-31 18:33:48.568 INFO 34018 --- [prometheus-minute-schedule-1,c2c50e358e39e54c,2417fbf4e4b65441] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:48.569 INFO 34018 --- [ocp-schedules-12,b11937df8646fca4,86580b22d658bd23] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:33:48.570 INFO 34018 --- [ocp-schedules-29,16b4912de156bdf0,fbea7493ae8a624a] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:33:48.572 INFO 34018 --- [ocp-schedules-5,4e2b19f75ef1c690,5f1eaadb37ba8da5] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:33:48.572 INFO 34018 --- [ocp-schedules-5,4e2b19f75ef1c690,5f1eaadb37ba8da5] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:33:48.577 INFO 34018 --- [ocp-schedules-14,784d3ba3ed2ce183,da38a77f26c4fe21] c.o.o.core.cache.helper.HostQueryCache : Finished init host cache. 2024-12-31 18:33:48.577 INFO 34018 --- [ocp-schedules-14,784d3ba3ed2ce183,da38a77f26c4fe21] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obQueryCache 2024-12-31 18:33:48.577 INFO 34018 --- [ocp-schedules-14,784d3ba3ed2ce183,da38a77f26c4fe21] c.o.ocp.core.cache.helper.ObQueryCache : Init ob cache. 2024-12-31 18:33:48.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:33:48.588476+08:00, lastProcessTime=2024-12-31T18:33:38.590068+08:00 2024-12-31 18:33:48.590 INFO 34018 --- [ocp-schedules-14,784d3ba3ed2ce183,da38a77f26c4fe21] c.o.ocp.core.cache.helper.ObQueryCache : Finished init ob cache. 2024-12-31 18:33:48.590 INFO 34018 --- [ocp-schedules-14,784d3ba3ed2ce183,da38a77f26c4fe21] c.o.o.s.common.scheduled.CacheSchedules : Refresh cache bean: obProxyQueryCache 2024-12-31 18:33:48.590 INFO 34018 --- [ocp-schedules-14,784d3ba3ed2ce183,da38a77f26c4fe21] c.o.o.c.cache.helper.ObProxyQueryCache : Init obproxy cache. 2024-12-31 18:33:48.593 INFO 34018 --- [ocp-schedules-9,e0c89e5a6912a9ac,f86d81a31c57eab8] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:33:48.594 INFO 34018 --- [ocp-schedules-14,784d3ba3ed2ce183,da38a77f26c4fe21] c.o.o.c.cache.helper.ObProxyQueryCache : Finished init obproxy cache. 2024-12-31 18:33:48.611 WARN 34018 --- [ocp-async-6,00bf384c8dce875d,3f3791e9cc235f57] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:48.619 INFO 34018 --- [ocp-async-5,0dfd80ad950cb5e1,0be4bee3c68689dd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:48.625 INFO 34018 --- [ocp-schedules-7,fc0eb285c8d64439,ca50fc42c6b8a1d5] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:33:48.631 INFO 34018 --- [ocp-schedules-7,fc0eb285c8d64439,ca50fc42c6b8a1d5] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:33:48.631 INFO 34018 --- [ocp-schedules-7,fc0eb285c8d64439,ca50fc42c6b8a1d5] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2024-12-31 18:33:48.635 INFO 34018 --- [ocp-schedules-2,dfd186f76aa8d952,9c42c03c112ac6ac] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2024-12-31 18:33:48.639 INFO 34018 --- [ocp-schedules-2,dfd186f76aa8d952,9c42c03c112ac6ac] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:33:48.644 INFO 34018 --- [ocp-schedules-26,da843a64e4b2ba2f,484d72732b8bdc98] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:33:48.644 INFO 34018 --- [ocp-schedules-26,da843a64e4b2ba2f,484d72732b8bdc98] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:33:48.681 INFO 34018 --- [ocp-schedules-26,da843a64e4b2ba2f,484d72732b8bdc98] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:33:48.681 INFO 34018 --- [ocp-schedules-26,da843a64e4b2ba2f,484d72732b8bdc98] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:33:48.687 INFO 34018 --- [ocp-schedules-21,f7473b88e2b1d99e,595dafb2a5549708] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:33:48.711 INFO 34018 --- [ocp-schedules-27,3b2008269acf06de,98a19c3c4831b019] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:33:48.711 INFO 34018 --- [ocp-schedules-27,3b2008269acf06de,98a19c3c4831b019] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:33:48.713 INFO 34018 --- [ocp-schedules-27,3b2008269acf06de,98a19c3c4831b019] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:33:48.713 INFO 34018 --- [ocp-schedules-27,3b2008269acf06de,98a19c3c4831b019] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730654274633891840 2024-12-31 18:33:48.714 INFO 34018 --- [ocp-schedules-27,3b2008269acf06de,98a19c3c4831b019] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:33:48.714 INFO 34018 --- [ocp-schedules-27,3b2008269acf06de,98a19c3c4831b019] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730654315150868480 2024-12-31 18:33:48.716 INFO 34018 --- [ocp-schedules-27,3b2008269acf06de,98a19c3c4831b019] c.o.ocp.monitor.service.IdKeyService : Sync record key and id, newRecordIdsCount=8, maxSyncedRecordId=730654881381908480 2024-12-31 18:33:48.726 ERROR 34018 --- [ocp-schedules-2,dfd186f76aa8d952,9c42c03c112ac6ac] .o.o.s.t.b.c.AbstractShardingClusterTask : process cluster error java.util.concurrent.ExecutionException: com.oceanbase.ocp.service.profile.exception.CredentialMissingException: [OCP CredentialMissingException]: status=428 PRECONDITION_REQUIRED, errorCode=IAM_CREDENTIAL_REQUIRED, args=myoceanbase,sys,ocp_monitor at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.run(AbstractShardingClusterTask.java:77) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.run(AbstractShardingClusterTask.java:47) at com.oceanbase.ocp.server.common.scheduled.ClusterSchedules.syncRootServer(ClusterSchedules.java:85) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.oceanbase.ocp.service.profile.exception.CredentialMissingException: [OCP CredentialMissingException]: status=428 PRECONDITION_REQUIRED, errorCode=IAM_CREDENTIAL_REQUIRED, args=myoceanbase,sys,ocp_monitor at com.oceanbase.ocp.service.profile.exception.CredentialMissingException.ob(CredentialMissingException.java:34) at com.oceanbase.ocp.service.credential.CredentialServiceImpl.acquireJdbcPasswordInner(CredentialServiceImpl.java:166) at com.oceanbase.ocp.service.credential.CredentialServiceImpl.acquireObPassword(CredentialServiceImpl.java:143) at com.oceanbase.ocp.service.credential.CredentialServiceImpl$$FastClassBySpringCGLIB$$6855c59e.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.service.credential.CredentialServiceImpl$$EnhancerBySpringCGLIB$$16fc940d.acquireObPassword() at com.oceanbase.ocp.service.ob.obsdk.factory.ConnectPropertiesBuilder.acquirePassword(ConnectPropertiesBuilder.java:204) at com.oceanbase.ocp.service.ob.obsdk.factory.ConnectPropertiesBuilder.buildConnectProperties(ConnectPropertiesBuilder.java:97) at com.oceanbase.ocp.service.ob.obsdk.factory.AbstractObOperatorFactory.buildConnectProperties(AbstractObOperatorFactory.java:324) at com.oceanbase.ocp.service.ob.obsdk.factory.AbstractObOperatorFactory.createObOperator(AbstractObOperatorFactory.java:117) at com.oceanbase.ocp.service.task.business.cluster.RefreshRsListTask.getRsList(RefreshRsListTask.java:90) at com.oceanbase.ocp.service.task.business.cluster.RefreshRsListTask.processCluster(RefreshRsListTask.java:42) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.lambda$run$1(AbstractShardingClusterTask.java:70) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted 2024-12-31 18:33:48.726 INFO 34018 --- [ocp-schedules-2,dfd186f76aa8d952,9c42c03c112ac6ac] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=0 2024-12-31 18:33:48.740 INFO 34018 --- [ocp-schedules-3,2aa614882d7ad372,63c914f86bc91792] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:33:48.740+08:00, clusters=[1] 2024-12-31 18:33:48.744 INFO 34018 --- [ocp-schedules-3,2aa614882d7ad372,63c914f86bc91792] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster myoceanbase for slowSqlStat, sql count is 0. 2024-12-31 18:33:48.759 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:33:48.588476+08:00 2024-12-31 18:33:48.773 INFO 34018 --- [ocp-schedules-11,48f54226840d5c94,508f7c8309a59be8] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:33:48.773+08:00, clusters=[1] 2024-12-31 18:33:48.780 INFO 34018 --- [ocp-schedules-11,48f54226840d5c94,508f7c8309a59be8] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster myoceanbase, trans stat result is empty. 2024-12-31 18:33:48.791 INFO 34018 --- [ocp-schedules-8,6628d5372961355e,c31a388d8a289e11] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:33:48.792 INFO 34018 --- [ocp-schedules-8,5e6b4e7c72b2b896,8525a8e72c961155] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:33:48.796 INFO 34018 --- [ocp-schedules-8,5e6b4e7c72b2b896,8525a8e72c961155] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:33:48.838 INFO 34018 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] cluster is not accessible, skip sync cluster, clusterId=1, status=TAKINGOVER 2024-12-31 18:33:48.838 INFO 34018 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=false, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:33:48.865 INFO 34018 --- [ocp-schedules-30,11ee989e1955653f,7ba327c24fbf40b7] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:33:48.870 INFO 34018 --- [ocp-schedules-30,11ee989e1955653f,7ba327c24fbf40b7] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:33:49.005 ERROR 34018 --- [Sync all tenant information1,,] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.NotFoundException occurred with code error.ob.tenant.name.not.found, and args [myoceanbase, sys] 2024-12-31 18:33:49.007 ERROR 34018 --- [ocp-schedules-30,11ee989e1955653f,7ba327c24fbf40b7] .o.o.s.t.b.c.AbstractShardingClusterTask : process cluster error java.util.concurrent.ExecutionException: com.oceanbase.ocp.core.exception.NotFoundException: [OCP NotFoundException]: status=404 NOT_FOUND, errorCode=OB_TENANT_NAME_NOT_FOUND, args=myoceanbase,sys at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.run(AbstractShardingClusterTask.java:77) at com.oceanbase.ocp.server.common.scheduled.TenantSchedules.syncAllTenantInfo(TenantSchedules.java:43) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.oceanbase.ocp.core.exception.NotFoundException: [OCP NotFoundException]: status=404 NOT_FOUND, errorCode=OB_TENANT_NAME_NOT_FOUND, args=myoceanbase,sys at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at com.oceanbase.ocp.core.util.ExceptionUtils.newException(ExceptionUtils.java:96) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.lambda$getSysTenant$5(TenantDaoManagerImpl.java:171) at java.util.Optional.orElseThrow(Optional.java:290) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.getSysTenant(TenantDaoManagerImpl.java:171) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$a55dcec2.getSysTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantSyncServiceImpl.markSysTenantUnavailable(TenantSyncServiceImpl.java:271) at com.oceanbase.ocp.service.task.business.tenant.SyncAllTenantInfoShardingTask.processCluster(SyncAllTenantInfoShardingTask.java:38) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.lambda$run$1(AbstractShardingClusterTask.java:70) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted 2024-12-31 18:33:49.007 INFO 34018 --- [ocp-schedules-30,11ee989e1955653f,7ba327c24fbf40b7] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=0 2024-12-31 18:33:49.397 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:49.398 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:49.431 INFO 34018 --- [ocp-schedules-22,bc94508505ed9703,32344d8deba86cc5] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:33:49.442 INFO 34018 --- [ocp-schedules-22,bc94508505ed9703,32344d8deba86cc5] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:33:49.442 INFO 34018 --- [ocp-schedules-22,bc94508505ed9703,32344d8deba86cc5] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:33:49.824 INFO 34018 --- [ocp-schedules-21,593e9a805e8260a4,55fd727363ca7984] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[10.79.169.37, 10.79.169.38, 10.79.169.36] 2024-12-31 18:33:49.824 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=3 2024-12-31 18:33:49.824 INFO 34018 --- [ocp-schedules-21,593e9a805e8260a4,55fd727363ca7984] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=2 2024-12-31 18:33:49.824 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=1 2024-12-31 18:33:49.840 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:33:49.840 INFO 34018 --- [ocp-schedules-21,593e9a805e8260a4,55fd727363ca7984] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:33:49.840 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:33:49.843 WARN 34018 --- [ocp-schedules-21,593e9a805e8260a4,55fd727363ca7984] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:33:49.843 WARN 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:33:49.844 WARN 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:33:49.844 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:33:49.844 INFO 34018 --- [ocp-schedules-21,593e9a805e8260a4,55fd727363ca7984] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:33:49.844 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:33:49.847 WARN 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:33:49.847 WARN 34018 --- [ocp-schedules-21,593e9a805e8260a4,55fd727363ca7984] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:33:49.847 WARN 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:33:49.855 INFO 34018 --- [ocp-schedules-21,593e9a805e8260a4,55fd727363ca7984] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.38:62889/api/v1/log/alarms, params:null 2024-12-31 18:33:49.856 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.36:62889/api/v1/log/alarms, params:null 2024-12-31 18:33:49.858 INFO 34018 --- [ForkJoinPool.commonPool-worker-38,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.37:62889/api/v1/log/alarms, params:null 2024-12-31 18:33:49.865 ERROR 34018 --- [ocp-schedules-21,593e9a805e8260a4,55fd727363ca7984] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task java.lang.RuntimeException: java.lang.reflect.InvocationTargetException at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:79) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) ... 10 common frames omitted Caused by: com.oceanbase.ocp.executor.exception.HttpConnectFailedException: connect to agent failed, ConnectException: Connection refused (Connection refused) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.safeExecute(HttpTemplate.java:498) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.doGet(HttpTemplate.java:217) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.get(HttpTemplate.java:82) at com.oceanbase.ocp.executor.executor.MonitorExecutor.getAlarms(MonitorExecutor.java:51) at com.oceanbase.ocp.compute.agent.manager.HostAgentAlarmManagerImpl.getHostAgentAlarms(HostAgentAlarmManagerImpl.java:62) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl.getHostAgentAlarmsByHost(HostAgentServiceImpl.java:1086) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl$$FastClassBySpringCGLIB$$e7947c56.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl$$EnhancerBySpringCGLIB$$b664ab35.getHostAgentAlarmsByHost() at com.oceanbase.ocp.server.common.scheduled.HostSchedules.lambda$getHostAgentAlarms$1(HostSchedules.java:105) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:731) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Caused by: javax.ws.rs.ProcessingException: org.apache.http.conn.HttpHostConnectException: Connect to 10.79.169.36:62889 [/10.79.169.36] failed: Connection refused (Connection refused) at org.glassfish.jersey.apache.connector.ApacheConnector.apply(ApacheConnector.java:519) at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:297) at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$2(JerseyInvocation.java:687) at org.glassfish.jersey.client.JerseyInvocation.call(JerseyInvocation.java:697) at org.glassfish.jersey.client.JerseyInvocation.lambda$runInScope$3(JerseyInvocation.java:691) at org.glassfish.jersey.internal.Errors.process(Errors.java:292) at org.glassfish.jersey.internal.Errors.process(Errors.java:274) at org.glassfish.jersey.internal.Errors.process(Errors.java:205) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:390) at org.glassfish.jersey.client.JerseyInvocation.runInScope(JerseyInvocation.java:691) at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:686) at org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:432) at org.glassfish.jersey.client.JerseyInvocation$Builder.get(JerseyInvocation.java:323) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.lambda$doGet$0(HttpTemplate.java:217) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.safeExecute(HttpTemplate.java:489) ... 21 common frames omitted Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 10.79.169.36:62889 [/10.79.169.36] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:72) at org.glassfish.jersey.apache.connector.ApacheConnector.apply(ApacheConnector.java:471) ... 35 common frames omitted Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 44 common frames omitted 2024-12-31 18:33:50.611 WARN 34018 --- [ocp-async-3,1b891b8ee937fc0a,40e39a1d95e738b5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:50.619 INFO 34018 --- [ocp-async-4,0da98c88bdeb8a94,52841869050a39db] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:51.568 INFO 34018 --- [prometheus-minute-schedule-1,089b89fbaf444c62,24ea956c16e0ac18] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:51.889 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:33:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:33:52.399 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:52.400 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:52.611 WARN 34018 --- [ocp-async-4,c5c35f2178c5d424,0492987d171da7fc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:52.619 INFO 34018 --- [ocp-async-10,de2dc1a2cd070066,08f586a66c575e25] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:53.137 INFO 34018 --- [ocp-schedules-3,10224781a7bee519,38bf89e95affedae] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:33:54.568 INFO 34018 --- [prometheus-minute-schedule-1,30581c8ca8424acf,b38c00a5136131b8] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:54.611 WARN 34018 --- [ocp-async-10,e80866fea1f03269,6802f3998ca1b60e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:54.619 INFO 34018 --- [ocp-async-6,96aca378ad8508d4,07ff0996e9f14a81] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:55.401 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:55.402 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:56.611 WARN 34018 --- [ocp-async-6,675a69785e37edc7,0c4dcb85241e1e98] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:56.620 INFO 34018 --- [ocp-async-3,bcd5236c52d5fe31,2a408d1134e91c59] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:57.568 INFO 34018 --- [prometheus-minute-schedule-1,f78e275ae91697b0,7940843c5545f9dc] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641240, interval=60 2024-12-31 18:33:58.402 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:33:58.404 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:33:58.465 INFO 34018 --- [ocp-schedules-15,d375b72c1787954f,839086f47dc03d4a] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2024-12-31 18:33:58.465 INFO 34018 --- [ocp-schedules-25,0e68cb7dfb2e4a23,ba59a4228a90a542] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:33:58.507 INFO 34018 --- [ocp-async-9,9d1291bb0e9c6d02,3dfca30967fb7b9a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:33:58.571 INFO 34018 --- [ocp-schedules-19,09e3b9682744a44f,b312fae611095017] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:33:58.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:33:58.589682+08:00, lastProcessTime=2024-12-31T18:33:48.588476+08:00 2024-12-31 18:33:58.611 WARN 34018 --- [ocp-async-4,50f275b5e52b81ec,5979b72bfb44e376] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:33:58.620 INFO 34018 --- [ocp-async-10,eb4e0cc89103bbcb,64fefd4598957d63] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:33:58.761 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:33:58.589682+08:00 2024-12-31 18:34:00.568 INFO 34018 --- [prometheus-minute-schedule-1,75b900f6d347f046,87e330d3461e44ae] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:00.612 WARN 34018 --- [ocp-async-7,5a696af162c60dcb,d1f1bfab7a37991e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:00.620 INFO 34018 --- [ocp-async-6,9116b8f3d34edbae,13b666cb37f50bfe] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:01.404 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:01.406 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:02.612 WARN 34018 --- [ocp-async-5,16eea3e69d77cb92,482424f1a871c6d0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:02.620 INFO 34018 --- [ocp-async-9,322cba01b88e1cde,7ab05f7148ebfe41] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:03.345 INFO 34018 --- [ocp-schedules-12,83f62d7cdea9bfd9,a41d78093dc8d96f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:34:03.568 INFO 34018 --- [prometheus-minute-schedule-1,bf50776402b3cd7a,69b3d69e6f3364e7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:04.162 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule start 2024-12-31 18:34:04.209 WARN 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Skip cluster myoceanbase(1), status=TAKINGOVER 2024-12-31 18:34:04.209 INFO 34018 --- [sql-rollup-daemon,,] s.i.c.SqlAuditRawStatRollupDaemonService : Rollup schedule end, elapsed=47ms, period=120000ms 2024-12-31 18:34:04.406 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:04.408 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:04.612 WARN 34018 --- [ocp-async-8,3d7ecc72f79a628b,1b491a92e7f35c83] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:04.620 INFO 34018 --- [ocp-async-1,ea80584787050e34,2f58bc43167737c5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:06.568 INFO 34018 --- [prometheus-minute-schedule-1,2c9a2e4a89bb4e91,9a485f255a68f724] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:06.612 WARN 34018 --- [ocp-async-10,1f6ede2409cf1bb0,cd182c5ea19d715a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:06.620 INFO 34018 --- [ocp-async-2,8d8644ddf0713b99,7752a9c180a029ae] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:07.408 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:07.410 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:08.508 INFO 34018 --- [ocp-async-2,6bb0cf610c094ae5,ef882e62e783545a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:34:08.574 INFO 34018 --- [ocp-schedules-15,bb49c25b87b79e3a,2047692b9ac9be57] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:34:08.576 INFO 34018 --- [ocp-schedules-7,175d146b65297232,b05b9c77aa19da56] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:34:08.581 INFO 34018 --- [ocp-schedules-7,175d146b65297232,b05b9c77aa19da56] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:34:08.582 INFO 34018 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2024-12-31 18:34:08.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:34:08.589624+08:00, lastProcessTime=2024-12-31T18:33:58.589682+08:00 2024-12-31 18:34:08.612 WARN 34018 --- [ocp-async-5,19163a789104b03f,4861466f235f8896] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:08.621 INFO 34018 --- [ocp-async-9,e803aff30a6f14da,292dae69cc53ce2c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:08.763 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:34:08.589624+08:00 2024-12-31 18:34:09.445 INFO 34018 --- [ocp-schedules-11,ca93d5b9c579a4dd,bc68dabe4d9d249c] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:34:09.454 INFO 34018 --- [ocp-schedules-11,ca93d5b9c579a4dd,bc68dabe4d9d249c] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:34:09.454 INFO 34018 --- [ocp-schedules-11,ca93d5b9c579a4dd,bc68dabe4d9d249c] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:34:09.568 INFO 34018 --- [prometheus-minute-schedule-1,1b77f90c1d2350ac,446ccabe34cdb21b] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:10.003 INFO 34018 --- [ocp-schedules-6,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:34:10.003 INFO 34018 --- [ocp-schedules-19,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:34:10.410 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:10.412 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:10.613 WARN 34018 --- [ocp-async-8,daaf6841190b831a,85e62544b1bdf682] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:10.621 INFO 34018 --- [ocp-async-1,899e0b867d77c21c,844b787b4857b043] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:10.910 WARN 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = ob_memory_percent,ob_tenant_cpu_percent,ob_tenant_disk_usage_v4, label = app=OB, gbLabel = app, ob_cluster_name, ob_cluster_id, tenant_name 2024-12-31 18:34:10.910 WARN 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = sql_all_count,sql_select_count,sql_insert_count,sql_update_count,sql_replace_count,sql_delete_count,sql_other_count,sql_all_rt,sql_select_rt,sql_insert_rt,sql_update_rt,sql_replace_rt,sql_delete_rt,sql_other_rt,sql_local_count,sql_remote_count,sql_distributed_count,sql_local_time,sql_remote_time,sql_distributed_time,active_session,all_session,wait_event_count,system_event_application_total_waits,system_event_configuration_total_waits,system_event_administrative_total_waits,system_event_concurrency_total_waits,system_event_commit_total_waits,system_event_network_total_waits,system_event_user_io_total_waits,system_event_system_io_total_waits,system_event_cluster_total_waits,system_event_other_total_waits,wait_event_rt,system_event_application_time_waited,system_event_configuration_time_waited,system_event_administrative_time_waited,system_event_concurrency_time_waited,system_event_commit_time_waited,system_event_network_time_waited,system_event_user_io_time_waited,system_event_system_io_time_waited,system_event_cluster_time_waited,system_event_other_time_waited,request_enqueue_count,request_dequeue_count,request_queue_time,ob_tenant_cpu_percent,ob_tenant_thread_percent,ob_memory_percent,memstore_percent,rpc_packet_in_rt,rpc_packet_out_rt,rpc_packet_in,rpc_packet_out,opened_cursors_count,max_full_clog_sync_delay_seconds,max_readonly_clog_sync_delay_seconds,max_logonly_clog_sync_delay_seconds,tps,transaction_commit_count,transaction_rollback_count,transaction_timeout_count,trans_sp_total_used_time,trans_distributed_total_used_time,tps_rt,transaction_commit_rt,transaction_rollback_rt,trans_commit_log_count,clog_trans_log_total_size,trans_commit_log_sync_rt,clog_write_disk_rt,memstore_write_lock_succ_count,memstore_write_lock_fail_count,memstore_write_lock_wait_time,transaction_single_partition_count,transaction_multi_partition_count,total_memstore_used,active_memstore_used,major_freeze_trigger,memstore_limit,io_read_count,io_write_count,io_read_rt,io_write_rt,io_read_size,io_writ 2024-12-31 18:34:10.911 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 1, ruleSize = 1. 2024-12-31 18:34:10.930 WARN 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = ob_memory_percent,ob_tenant_cpu_percent,ob_tenant_disk_usage_v4, label = app=OB, gbLabel = app, ob_cluster_name, ob_cluster_id, tenant_name 2024-12-31 18:34:10.930 WARN 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = sql_all_count,sql_select_count,sql_insert_count,sql_update_count,sql_replace_count,sql_delete_count,sql_other_count,sql_all_rt,sql_select_rt,sql_insert_rt,sql_update_rt,sql_replace_rt,sql_delete_rt,sql_other_rt,sql_local_count,sql_remote_count,sql_distributed_count,sql_local_time,sql_remote_time,sql_distributed_time,active_session,all_session,wait_event_count,system_event_application_total_waits,system_event_configuration_total_waits,system_event_administrative_total_waits,system_event_concurrency_total_waits,system_event_commit_total_waits,system_event_network_total_waits,system_event_user_io_total_waits,system_event_system_io_total_waits,system_event_cluster_total_waits,system_event_other_total_waits,wait_event_rt,system_event_application_time_waited,system_event_configuration_time_waited,system_event_administrative_time_waited,system_event_concurrency_time_waited,system_event_commit_time_waited,system_event_network_time_waited,system_event_user_io_time_waited,system_event_system_io_time_waited,system_event_cluster_time_waited,system_event_other_time_waited,request_enqueue_count,request_dequeue_count,request_queue_time,ob_tenant_cpu_percent,ob_tenant_thread_percent,ob_memory_percent,memstore_percent,rpc_packet_in_rt,rpc_packet_out_rt,rpc_packet_in,rpc_packet_out,opened_cursors_count,max_full_clog_sync_delay_seconds,max_readonly_clog_sync_delay_seconds,max_logonly_clog_sync_delay_seconds,tps,transaction_commit_count,transaction_rollback_count,transaction_timeout_count,trans_sp_total_used_time,trans_distributed_total_used_time,tps_rt,transaction_commit_rt,transaction_rollback_rt,trans_commit_log_count,clog_trans_log_total_size,trans_commit_log_sync_rt,clog_write_disk_rt,memstore_write_lock_succ_count,memstore_write_lock_fail_count,memstore_write_lock_wait_time,transaction_single_partition_count,transaction_multi_partition_count,total_memstore_used,active_memstore_used,major_freeze_trigger,memstore_limit,io_read_count,io_write_count,io_read_rt,io_write_rt,io_read_size,io_writ 2024-12-31 18:34:10.930 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 5, ruleSize = 5. 2024-12-31 18:34:12.568 INFO 34018 --- [prometheus-minute-schedule-1,fec355c2d5d97545,84a5d940401e9786] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:12.569 INFO 34018 --- [prometheus-hour-schedule-1,f740e319fd64297b,56829cf131ed99c3] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:34:12.613 WARN 34018 --- [ocp-async-10,32e91e1761f8f840,7dce90c0b5ce891e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:12.621 INFO 34018 --- [ocp-async-2,cc3264ef87632c57,0c9dde22c0e1fb3b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:12.685 INFO 34018 --- [metric-archive-second-37,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641180, nodeCount=2, affectRows=2 2024-12-31 18:34:12.685 INFO 34018 --- [metric-archive-second-37,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641180, nodeCount=2, validCount=2 2024-12-31 18:34:12.687 INFO 34018 --- [metric-archive-second-38,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641180, nodeCount=12, affectRows=12 2024-12-31 18:34:12.687 INFO 34018 --- [metric-archive-second-38,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641180, nodeCount=11, validCount=11 2024-12-31 18:34:12.688 INFO 34018 --- [metric-archive-second-32,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641180, nodeCount=47, affectRows=47 2024-12-31 18:34:12.688 INFO 34018 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641180, nodeCount=31, affectRows=31 2024-12-31 18:34:12.688 INFO 34018 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641180, nodeCount=39, affectRows=39 2024-12-31 18:34:12.688 INFO 34018 --- [metric-archive-second-3,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641180, nodeCount=38, validCount=38 2024-12-31 18:34:12.688 INFO 34018 --- [metric-archive-second-4,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641180, nodeCount=31, validCount=31 2024-12-31 18:34:12.688 INFO 34018 --- [metric-archive-second-32,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641180, nodeCount=47, validCount=47 2024-12-31 18:34:12.692 INFO 34018 --- [metric-archive-second-16,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641180, nodeCount=256, affectRows=256 2024-12-31 18:34:12.693 INFO 34018 --- [metric-archive-second-16,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641180, nodeCount=255, validCount=255 2024-12-31 18:34:13.412 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:13.414 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:13.423 INFO 34018 --- [ocp-schedules-4,2b499cb21dd8258b,85625c9b9eef67af] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:34:14.613 WARN 34018 --- [ocp-async-6,969c87945b8f7ea0,0e969ef0eac0f9ca] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:14.621 INFO 34018 --- [ocp-async-3,ff4ca64b6dc65265,4a8785ae35b3b30e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:15.568 INFO 34018 --- [prometheus-minute-schedule-1,4ca36ba87e156022,0dcb10817c6a0050] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:16.414 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:16.416 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:16.613 WARN 34018 --- [ocp-async-9,33d21989ffca6888,f16baa8510333242] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:16.621 INFO 34018 --- [ocp-async-4,b4a481dae966e550,455867afb6628f5a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:18.457 INFO 34018 --- [ocp-schedules-1,351698fd6fe30862,012c64000ad981ae] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:34:18.457 INFO 34018 --- [ocp-schedules-30,c6ec443573828066,97b8ced7b56de046] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:34:18.458 INFO 34018 --- [ocp-schedules-10,13462b943a44f595,5d4ee34f5ea138aa] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:34:18.464 INFO 34018 --- [ocp-schedules-30,c6ec443573828066,97b8ced7b56de046] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:34:18.464 INFO 34018 --- [ocp-schedules-1,351698fd6fe30862,012c64000ad981ae] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:34:18.464 INFO 34018 --- [ocp-schedules-27,28289bc28d700bae,5c8895e400b16663] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:34:18.464 INFO 34018 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : skip cluster not running and unavailable, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:34:18.470 INFO 34018 --- [ocp-schedules-24,a93427975513738d,ff85302b732136c6] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:34:18.470 INFO 34018 --- [ocp-schedules-24,a93427975513738d,ff85302b732136c6] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:34:18.470 INFO 34018 --- [ocp-schedules-19,a8bfc64973e28405,44edc6b2e24be057] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:34:18.470 INFO 34018 --- [ocp-schedules-19,a8bfc64973e28405,44edc6b2e24be057] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:34:18.471 INFO 34018 --- [ocp-schedules-16,b86a00b119fcbdb7,223ddd1b445a29aa] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:34:18.471 INFO 34018 --- [ocp-schedules-16,b86a00b119fcbdb7,223ddd1b445a29aa] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:34:18.508 INFO 34018 --- [ocp-async-4,521720c647a63ac6,adb4a76ec9578dfd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:34:18.568 INFO 34018 --- [prometheus-minute-schedule-1,56477095138e453c,3d688607183fd0b2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:18.577 INFO 34018 --- [ocp-schedules-15,e70ce0aa9b44b54a,44dee3ffa9073ca8] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:34:18.582 INFO 34018 --- [ocp-schedules-7,175d146b65297232,b05b9c77aa19da56] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:34:18.595 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:34:18.594624+08:00, lastProcessTime=2024-12-31T18:34:08.589624+08:00 2024-12-31 18:34:18.595 INFO 34018 --- [ocp-schedules-3,d4480a1a747cf42c,2750e55fc2dc42e0] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:34:18.613 WARN 34018 --- [ocp-async-10,2c65d76778bb78fa,48dd14adb4ad771a] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:18.621 INFO 34018 --- [ocp-async-2,eef24f511a064407,7c434e86ad510f7f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:18.771 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:34:18.594624+08:00 2024-12-31 18:34:18.839 INFO 34018 --- [ocp-schedules-8,5e6b4e7c72b2b896,8525a8e72c961155] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:34:18.839 INFO 34018 --- [ocp-schedules-8,ef79a3c45fa02f64,4b3a86ead0547daa] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:34:18.844 INFO 34018 --- [ocp-schedules-8,ef79a3c45fa02f64,4b3a86ead0547daa] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:34:18.889 INFO 34018 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] cluster is not accessible, skip sync cluster, clusterId=1, status=TAKINGOVER 2024-12-31 18:34:18.889 INFO 34018 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=false, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:34:19.416 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:19.418 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:20.613 WARN 34018 --- [ocp-async-6,56573c683b213952,2b3a3302a556fae6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:20.622 INFO 34018 --- [ocp-async-3,8c2dc8cfc2b2b649,fdb497ea16478d7f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:21.568 INFO 34018 --- [prometheus-minute-schedule-1,a73355816967020b,fde7203bdb355fe9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:22.418 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:22.420 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:22.614 WARN 34018 --- [ocp-async-9,c6d11c045fa4b19f,da4ceed1f4246b67] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:22.622 INFO 34018 --- [ocp-async-4,810ae55e57a73eb6,99e3138aafb8d7ae] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:23.478 INFO 34018 --- [ocp-schedules-6,9df3b1061daa32f5,fe1e48509e49d4c3] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:34:24.568 INFO 34018 --- [prometheus-minute-schedule-1,efcbb28c06ab93a0,0cb458dec75713b4] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:24.614 WARN 34018 --- [ocp-async-1,34e9c3fb65a5a401,0a55923d79ad1ff5] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:24.622 INFO 34018 --- [ocp-async-7,95f7d6677d8754f1,5e96a8fdabaf4d2b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:25.420 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:25.421 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:26.614 WARN 34018 --- [ocp-async-2,7eafaa4cc7503203,6ec488ce96200bd6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:26.622 INFO 34018 --- [ocp-async-5,bdffa41606df1ae6,ff8921c7f04d9e56] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:27.568 INFO 34018 --- [prometheus-minute-schedule-1,f8eb2ba2371cb7da,d234e9492f2cf572] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:28.421 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:28.423 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:28.464 INFO 34018 --- [ocp-schedules-30,c6ec443573828066,97b8ced7b56de046] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2024-12-31 18:34:28.465 INFO 34018 --- [ocp-schedules-1,351698fd6fe30862,012c64000ad981ae] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:34:28.508 INFO 34018 --- [ocp-async-5,15291a6dc464cf44,60bbaa94bc03ee20] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:34:28.580 INFO 34018 --- [ocp-schedules-4,b2750c4bc0fe7f59,cfcb61dce01fe5b6] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:34:28.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:34:28.588911+08:00, lastProcessTime=2024-12-31T18:34:18.594624+08:00 2024-12-31 18:34:28.614 WARN 34018 --- [ocp-async-9,ae926cb5b6ef2303,90d10357cc853907] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:28.622 INFO 34018 --- [ocp-async-4,516602f43cf5aa54,e4bd15dadc765355] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:28.771 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:34:28.588911+08:00 2024-12-31 18:34:29.456 INFO 34018 --- [ocp-schedules-18,76b71d5add202716,0ea730eb3e673150] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:34:29.464 INFO 34018 --- [ocp-schedules-18,76b71d5add202716,0ea730eb3e673150] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:34:29.464 INFO 34018 --- [ocp-schedules-18,76b71d5add202716,0ea730eb3e673150] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:34:30.568 INFO 34018 --- [prometheus-minute-schedule-1,d338616dbce3a6ff,5f373eb45825062d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:30.614 WARN 34018 --- [ocp-async-1,6d671739654a1f46,990c24aea1de7ef1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:30.623 INFO 34018 --- [ocp-async-7,9c50ca5ef50337ea,6785a7d6817f65b2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:31.423 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:31.425 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:32.614 WARN 34018 --- [ocp-async-2,188acca68d042b73,92840027a0533cbf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:32.623 INFO 34018 --- [ocp-async-5,13f5d3c0697db442,d3a680951053b4de] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:33.525 INFO 34018 --- [ocp-schedules-20,18a2f9556afd0419,ad3a9b9a0a236d8a] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:34:33.568 INFO 34018 --- [prometheus-minute-schedule-1,49afddf0e998513c,0301055ac0ca510d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:34.425 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:34.427 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:34.615 WARN 34018 --- [ocp-async-3,6e3e5e14ac8f9a35,74534c493869f528] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:34.623 INFO 34018 --- [ocp-async-8,972a7fe9faf07fb3,87814fd75d1be64c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:36.568 INFO 34018 --- [prometheus-minute-schedule-1,36ef744d36d8f0a5,fbfd9e2ea51fedb5] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:36.569 INFO 34018 --- [prometheus-cache-monitor1,62026a20efdd61d4,a6c0503443cfa7c9] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1518,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":387,"seriesIdKeySize":387,"secondWriteQueue":0,"minuteWriteCacheSize":384} 2024-12-31 18:34:36.569 INFO 34018 --- [prometheus-cache-monitor1,62026a20efdd61d4,a6c0503443cfa7c9] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=49, ob_cluster_status_check=7, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, ob_cluster_sync=6, http_server_requests_seconds_count=49, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:34:36.615 WARN 34018 --- [ocp-async-8,6a5d5674919fbfab,4eb0fa805cd2b72d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:36.623 INFO 34018 --- [ocp-async-10,62f5332233110ccd,13a817208abceed8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:36.709 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting PLAN_CHANGE_DETECTOR, Interval{start=2024-12-31T18:30:36.678, end=2024-12-31T18:32:36.706} 2024-12-31 18:34:36.713 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR : for [] 2024-12-31 18:34:36.713 INFO 34018 --- [pool-17-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : PLAN_CHANGE_DETECTOR, Found out 0 dubious sqls 2024-12-31 18:34:37.427 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:37.429 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:38.508 INFO 34018 --- [ocp-async-4,e3816a45edd525cd,1b24a6324b983f0f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:34:38.583 INFO 34018 --- [ocp-schedules-30,4a5be37b8a329c9a,c02b7ec3b297fe99] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:34:38.591 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:34:38.590562+08:00, lastProcessTime=2024-12-31T18:34:28.588911+08:00 2024-12-31 18:34:38.615 WARN 34018 --- [ocp-async-7,b9827bc3a3315235,cd4c34d8618244db] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:38.623 INFO 34018 --- [ocp-async-5,06916e7ba4b3847f,e705783295acbe59] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:38.777 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:34:38.590562+08:00 2024-12-31 18:34:39.568 INFO 34018 --- [prometheus-minute-schedule-1,070a2faebf291b01,20660223f4154851] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:40.004 INFO 34018 --- [ocp-schedules-12,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:34:40.004 INFO 34018 --- [ocp-schedules-23,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:34:40.429 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:40.431 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:40.615 WARN 34018 --- [ocp-async-5,a3a193bf8bdebe12,53a91ee3f6f8197f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:40.623 INFO 34018 --- [ocp-async-9,b055db69bd1f9bea,461a9ebdbbf9b845] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:42.568 INFO 34018 --- [prometheus-minute-schedule-1,ead3870842a93785,13d4935724cafba9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:42.616 WARN 34018 --- [ocp-async-9,0296f61fa7768adb,3791cb6808cf6da7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:42.624 INFO 34018 --- [ocp-async-10,6178d09fc502d325,c9dd39a460dde12e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:43.431 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:43.432 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:43.579 INFO 34018 --- [ocp-schedules-25,75fe4fca6d851ebb,1e359e2f86ab0368] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:34:44.616 WARN 34018 --- [ocp-async-10,ff77b7aa3b146a36,b90b78098e47f358] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:44.624 INFO 34018 --- [ocp-async-6,1ed683b8062f3da6,cd02642cb99afe06] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:45.568 INFO 34018 --- [prometheus-minute-schedule-1,f70f842af2f34089,fa887b4a2cb1aec2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:46.433 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:46.434 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:46.616 WARN 34018 --- [ocp-async-6,ee05e8d9e9e0330f,85fcef20ea9e98cd] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:46.624 INFO 34018 --- [ocp-async-3,d84c99e343ceae2b,432f91bff58b39a7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:48.457 INFO 34018 --- [ocp-schedules-26,5342b2a0d2270403,0cfdb94d940ab61b] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:34:48.458 INFO 34018 --- [ocp-schedules-12,6da81e609a106c5c,d2795137da1cf13a] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:34:48.459 INFO 34018 --- [ocp-schedules-10,e3638314f29408a4,8a51d3bd9abf9092] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:34:48.462 INFO 34018 --- [ocp-schedules-22,5ddc0c0ee5889992,7dfda583e454de27] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:34:48.464 INFO 34018 --- [ocp-schedules-26,5342b2a0d2270403,0cfdb94d940ab61b] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:34:48.464 INFO 34018 --- [ocp-schedules-12,6da81e609a106c5c,d2795137da1cf13a] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:34:48.464 INFO 34018 --- [ocp-schedules-1,2e666547142149c4,2b74e697dd2afb4b] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:34:48.465 INFO 34018 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : skip cluster not running and unavailable, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:34:48.465 INFO 34018 --- [ocp-schedules-6,3a10a1296de5729a,7ecee59209d537ff] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:34:48.466 INFO 34018 --- [ocp-schedules-4,b30510ea236c7957,eca6584aae3833d0] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster root server. 2024-12-31 18:34:48.470 INFO 34018 --- [ocp-schedules-22,5ddc0c0ee5889992,7dfda583e454de27] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:34:48.471 INFO 34018 --- [ocp-schedules-4,b30510ea236c7957,eca6584aae3833d0] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:34:48.472 INFO 34018 --- [ocp-schedules-1,2e666547142149c4,2b74e697dd2afb4b] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:34:48.473 INFO 34018 --- [ocp-schedules-28,e82e06a18e820abb,9006836e46248fc7] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:34:48.473 INFO 34018 --- [ocp-schedules-5,f40de5b10607d279,41f287cd13d9f879] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:34:48.473 INFO 34018 --- [ocp-schedules-28,e82e06a18e820abb,9006836e46248fc7] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:34:48.473 INFO 34018 --- [ocp-schedules-5,f40de5b10607d279,41f287cd13d9f879] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:34:48.473 INFO 34018 --- [ocp-schedules-16,e4bfd049313cfdfb,603ef29646bd4895] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:34:48.474 INFO 34018 --- [ocp-schedules-16,e4bfd049313cfdfb,603ef29646bd4895] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:34:48.483 INFO 34018 --- [ocp-schedules-25,fafd63b2dbfa16ed,5a7c225f81e95d96] c.o.o.s.common.scheduled.OcpSchedules : Cleanup ocp connection pools. 2024-12-31 18:34:48.483 INFO 34018 --- [ocp-schedules-25,fafd63b2dbfa16ed,5a7c225f81e95d96] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] clean up the expired connectors. 2024-12-31 18:34:48.509 INFO 34018 --- [ocp-async-9,35e17101159a989a,e471e91c60c105ee] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:34:48.524 INFO 34018 --- [ocp-schedules-19,759accdaf7232eaf,06bb0b02e09fd1fa] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant mini compaction 2024-12-31 18:34:48.524 INFO 34018 --- [ocp-schedules-19,759accdaf7232eaf,06bb0b02e09fd1fa] t.b.t.CollectAllTenantMiniCompactionTask : Begin to collect all tenants mini compaction info 2024-12-31 18:34:48.534 INFO 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper 2024-12-31 18:34:48.539 INFO 34018 --- [pool-12-thread-16,0c0c4161783cf9fb,cc1e135b0d08a8f5] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get outline history 2024-12-31 18:34:48.539 INFO 34018 --- [pool-12-thread-14,0c0c4161783cf9fb,afb28d0a8125590e] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to get cluster trans stat 2024-12-31 18:34:48.540 INFO 34018 --- [pool-12-thread-15,0c0c4161783cf9fb,8a1b4cd55a2304d6] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster session stat 2024-12-31 18:34:48.540 INFO 34018 --- [pool-12-thread-13,0c0c4161783cf9fb,0bea39e3554e0d12] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get Cluster Sql Stat 2024-12-31 18:34:48.540 INFO 34018 --- [pool-12-thread-13,0c0c4161783cf9fb,0bea39e3554e0d12] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster slow Sql Stat 2024-12-31 18:34:48.567 INFO 34018 --- [ForkJoinPool-11-worker-2,0c0c4161783cf9fb,25e8d11999255739] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get tenant session stat of myoceanbase 2024-12-31 18:34:48.567 INFO 34018 --- [ForkJoinPool-11-worker-2,0c0c4161783cf9fb,25e8d11999255739] c.o.o.p.o.i.OasSessionStatServiceImpl : Status:TAKINGOVER of Cluster ObClusterEntity{id=1, name=myoceanbase, obClusterId=1735638920, status=TAKINGOVER} is abnormal, skip getTenantSessionStat 2024-12-31 18:34:48.567 INFO 34018 --- [ForkJoinPool-11-worker-2,0c0c4161783cf9fb,25e8d11999255739] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching tenant session stat of myoceanbase 2024-12-31 18:34:48.567 INFO 34018 --- [ForkJoinPool-11-worker-9,0c0c4161783cf9fb,7a62936de16b441f] c.o.o.p.s.d.internal.OutlineServiceImpl : Status:TAKINGOVER of Cluster ObClusterEntity{id=1, name=myoceanbase, obClusterId=1735638920, status=TAKINGOVER} is abnormal, skip getOutlineHistory 2024-12-31 18:34:48.568 INFO 34018 --- [pool-12-thread-16,0c0c4161783cf9fb,cc1e135b0d08a8f5] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching outline history 2024-12-31 18:34:48.568 INFO 34018 --- [prometheus-minute-schedule-1,4391938ebd6d657b,3870d170f397b024] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:48.569 INFO 34018 --- [pool-12-thread-15,0c0c4161783cf9fb,8a1b4cd55a2304d6] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching session stat 2024-12-31 18:34:48.569 INFO 34018 --- [pool-12-thread-14,0c0c4161783cf9fb,afb28d0a8125590e] c.o.o.p.t.i.ObTransactionDiagServiceImpl : begin to attach trans id 2024-12-31 18:34:48.572 INFO 34018 --- [pool-12-thread-14,0c0c4161783cf9fb,afb28d0a8125590e] c.o.o.p.t.i.ObTransactionDiagServiceImpl : finish fetching trans data 2024-12-31 18:34:48.573 INFO 34018 --- [ocp-schedules-23,624a29b2f8b6b843,7a6f8dd758a335fe] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:34:48.576 INFO 34018 --- [ocp-schedules-10,b9ce08be18e609b8,c61298dfdf5a824b] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:34:48.576 INFO 34018 --- [ocp-schedules-10,b9ce08be18e609b8,c61298dfdf5a824b] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:34:48.579 INFO 34018 --- [pool-21-thread-1,759accdaf7232eaf,4e64e3151da59a0c] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect mini compaction info 2024-12-31 18:34:48.585 INFO 34018 --- [ocp-schedules-6,b1815517fed668fa,509f0074f1165f95] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:34:48.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:34:48.588184+08:00, lastProcessTime=2024-12-31T18:34:38.590562+08:00 2024-12-31 18:34:48.592 INFO 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:34:48.595 WARN 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:34:48.595 INFO 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:34:48.597 INFO 34018 --- [ocp-schedules-1,772e3c97c0f2fb37,d23a22bdef003cd7] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:34:48.598 WARN 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:34:48.605 INFO 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:34:48.607 WARN 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:34:48.608 INFO 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:34:48.610 WARN 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:34:48.616 WARN 34018 --- [ocp-async-4,fbf07291672874fb,a666f4e2a77d019e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:48.617 INFO 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:34:48.620 WARN 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:34:48.620 INFO 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:34:48.623 WARN 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:34:48.623 WARN 34018 --- [ocp-schedules-19,759accdaf7232eaf,06bb0b02e09fd1fa] t.b.t.CollectAllTenantMiniCompactionTask : Failed to collect mini compaction concurrently, errMsg:com.oceanbase.ocp.service.profile.exception.CredentialMissingException: [OCP CredentialMissingException]: status=428 PRECONDITION_REQUIRED, errorCode=IAM_CREDENTIAL_REQUIRED, args=myoceanbase,sys,ocp_monitor, cause:{} com.oceanbase.ocp.service.profile.exception.CredentialMissingException: [OCP CredentialMissingException]: status=428 PRECONDITION_REQUIRED, errorCode=IAM_CREDENTIAL_REQUIRED, args=myoceanbase,sys,ocp_monitor at com.oceanbase.ocp.service.profile.exception.CredentialMissingException.ob(CredentialMissingException.java:34) at com.oceanbase.ocp.service.credential.CredentialServiceImpl.acquireJdbcPasswordInner(CredentialServiceImpl.java:166) at com.oceanbase.ocp.service.credential.CredentialServiceImpl.acquireObPassword(CredentialServiceImpl.java:143) at com.oceanbase.ocp.service.credential.CredentialServiceImpl$$FastClassBySpringCGLIB$$6855c59e.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.service.credential.CredentialServiceImpl$$EnhancerBySpringCGLIB$$16fc940d.acquireObPassword() at com.oceanbase.ocp.service.ob.obsdk.factory.ConnectPropertiesBuilder.acquirePassword(ConnectPropertiesBuilder.java:204) at com.oceanbase.ocp.service.ob.obsdk.factory.ConnectPropertiesBuilder.buildConnectProperties(ConnectPropertiesBuilder.java:97) at com.oceanbase.ocp.service.ob.obsdk.factory.AbstractObOperatorFactory.buildConnectProperties(AbstractObOperatorFactory.java:324) at com.oceanbase.ocp.service.ob.obsdk.factory.AbstractObOperatorFactory.createObOperator(AbstractObOperatorFactory.java:117) at com.oceanbase.ocp.service.ob.obsdk.factory.AbstractObOperatorFactory.createCompactionOperator(AbstractObOperatorFactory.java:316) at com.oceanbase.ocp.obops.internal.tenant.TenantCompactionCollectServiceImpl.collectMiniCompaction(TenantCompactionCollectServiceImpl.java:124) at com.oceanbase.ocp.obops.internal.tenant.TenantCompactionCollectServiceImpl$$FastClassBySpringCGLIB$$7ded023a.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123) at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388) at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707) at com.oceanbase.ocp.obops.internal.tenant.TenantCompactionCollectServiceImpl$$EnhancerBySpringCGLIB$$74ef0b61.collectMiniCompaction() at com.oceanbase.ocp.service.task.business.tenant.CollectAllTenantMiniCompactionTask.lambda$run$1(CollectAllTenantMiniCompactionTask.java:46) at com.oceanbase.ocp.core.thread.ConcurrentExecutor.lambda$exec$2(ConcurrentExecutor.java:73) at com.oceanbase.ocp.core.thread.LocaleDecorator.lambda$decorate$1(LocaleDecorator.java:41) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$1(TraceDecorator.java:49) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2024-12-31 18:34:48.623 INFO 34018 --- [ocp-schedules-19,759accdaf7232eaf,06bb0b02e09fd1fa] t.b.t.CollectAllTenantMiniCompactionTask : Finish to collect all tenants mini compaction info 2024-12-31 18:34:48.624 INFO 34018 --- [ocp-async-7,04a4d4d6e62db35d,77ebb0ee6aa16ce1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:48.630 INFO 34018 --- [ocp-schedules-15,5ae8e675ad90e61d,d1f8d8862e78ac4a] c.o.o.m.helper.ExporterRequestHelper : Refresh exporter helper finished, credentialSize=3, cachedSize=3 2024-12-31 18:34:48.633 INFO 34018 --- [ocp-schedules-25,f75450ebb95f8685,d919e8c2fc1967e7] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:34:48.639 INFO 34018 --- [ocp-schedules-25,f75450ebb95f8685,d919e8c2fc1967e7] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:34:48.639 INFO 34018 --- [ocp-schedules-25,f75450ebb95f8685,d919e8c2fc1967e7] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2024-12-31 18:34:48.680 INFO 34018 --- [pool-12-thread-13,0c0c4161783cf9fb,0bea39e3554e0d12] c.o.o.p.oas.internal.OasStatServiceImpl : begin to get cluster anomaly sql Stat 2024-12-31 18:34:48.682 INFO 34018 --- [ocp-schedules-3,fc95b44e20243e53,b6d8409816bfc2a4] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:34:48.682 INFO 34018 --- [ocp-schedules-3,fc95b44e20243e53,b6d8409816bfc2a4] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:34:48.701 INFO 34018 --- [pool-12-thread-13,0c0c4161783cf9fb,0bea39e3554e0d12] c.o.o.p.oas.internal.OasStatServiceImpl : finish fetching cluster sql stat 2024-12-31 18:34:48.717 INFO 34018 --- [ocp-schedules-3,fc95b44e20243e53,b6d8409816bfc2a4] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:34:48.717 INFO 34018 --- [ocp-schedules-3,fc95b44e20243e53,b6d8409816bfc2a4] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:34:48.717 INFO 34018 --- [ocp-schedules-11,6a5509d2ad6ed651,8f2bbc1812423950] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:34:48.717 INFO 34018 --- [ocp-schedules-11,6a5509d2ad6ed651,8f2bbc1812423950] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:34:48.719 INFO 34018 --- [ocp-schedules-11,6a5509d2ad6ed651,8f2bbc1812423950] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:34:48.719 INFO 34018 --- [ocp-schedules-11,6a5509d2ad6ed651,8f2bbc1812423950] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730654274633891840 2024-12-31 18:34:48.720 INFO 34018 --- [ocp-schedules-11,6a5509d2ad6ed651,8f2bbc1812423950] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:34:48.720 INFO 34018 --- [ocp-schedules-11,6a5509d2ad6ed651,8f2bbc1812423950] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730654881381908480 2024-12-31 18:34:48.724 INFO 34018 --- [ocp-schedules-29,894ebf7de1e39de9,530f3a7ab709b8d7] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:34:48.733 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:34:48.588184+08:00 2024-12-31 18:34:48.782 INFO 34018 --- [ocp-schedules-30,11627f24edd8ecc2,cd80a4c82b5ab902] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:34:48.782+08:00, clusters=[1] 2024-12-31 18:34:48.785 INFO 34018 --- [ocp-schedules-30,11627f24edd8ecc2,cd80a4c82b5ab902] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster myoceanbase for slowSqlStat, sql count is 0. 2024-12-31 18:34:48.817 INFO 34018 --- [ocp-schedules-17,8d7fdb5ba73b4c2f,bd91d349e6f7986f] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:34:48.817+08:00, clusters=[1] 2024-12-31 18:34:48.819 INFO 34018 --- [ocp-schedules-17,8d7fdb5ba73b4c2f,bd91d349e6f7986f] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster myoceanbase, trans stat result is empty. 2024-12-31 18:34:48.890 INFO 34018 --- [ocp-schedules-8,ef79a3c45fa02f64,4b3a86ead0547daa] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:34:48.890 INFO 34018 --- [ocp-schedules-8,c1d8cc2b149c409c,ab2f4d12893ef8d6] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:34:48.895 INFO 34018 --- [ocp-schedules-8,c1d8cc2b149c409c,ab2f4d12893ef8d6] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:34:48.939 INFO 34018 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] cluster is not accessible, skip sync cluster, clusterId=1, status=TAKINGOVER 2024-12-31 18:34:48.939 INFO 34018 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=false, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:34:49.009 INFO 34018 --- [ocp-schedules-18,5c64000e66fca1ee,589f58c3920ab6b8] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:34:49.014 INFO 34018 --- [ocp-schedules-18,5c64000e66fca1ee,589f58c3920ab6b8] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:34:49.145 ERROR 34018 --- [Sync all tenant information1,,] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.NotFoundException occurred with code error.ob.tenant.name.not.found, and args [myoceanbase, sys] 2024-12-31 18:34:49.147 ERROR 34018 --- [ocp-schedules-18,5c64000e66fca1ee,589f58c3920ab6b8] .o.o.s.t.b.c.AbstractShardingClusterTask : process cluster error java.util.concurrent.ExecutionException: com.oceanbase.ocp.core.exception.NotFoundException: [OCP NotFoundException]: status=404 NOT_FOUND, errorCode=OB_TENANT_NAME_NOT_FOUND, args=myoceanbase,sys at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.run(AbstractShardingClusterTask.java:77) at com.oceanbase.ocp.server.common.scheduled.TenantSchedules.syncAllTenantInfo(TenantSchedules.java:43) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.oceanbase.ocp.core.exception.NotFoundException: [OCP NotFoundException]: status=404 NOT_FOUND, errorCode=OB_TENANT_NAME_NOT_FOUND, args=myoceanbase,sys at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at com.oceanbase.ocp.core.util.ExceptionUtils.newException(ExceptionUtils.java:96) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.lambda$getSysTenant$5(TenantDaoManagerImpl.java:171) at java.util.Optional.orElseThrow(Optional.java:290) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.getSysTenant(TenantDaoManagerImpl.java:171) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$a55dcec2.getSysTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantSyncServiceImpl.markSysTenantUnavailable(TenantSyncServiceImpl.java:271) at com.oceanbase.ocp.service.task.business.tenant.SyncAllTenantInfoShardingTask.processCluster(SyncAllTenantInfoShardingTask.java:38) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.lambda$run$1(AbstractShardingClusterTask.java:70) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted 2024-12-31 18:34:49.147 INFO 34018 --- [ocp-schedules-18,5c64000e66fca1ee,589f58c3920ab6b8] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=0 2024-12-31 18:34:49.435 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:49.436 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:49.468 INFO 34018 --- [ocp-schedules-14,10dc45fd5d59104f,b7a7af676ac8a075] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:34:49.477 INFO 34018 --- [ocp-schedules-14,10dc45fd5d59104f,b7a7af676ac8a075] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:34:49.477 INFO 34018 --- [ocp-schedules-14,10dc45fd5d59104f,b7a7af676ac8a075] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:34:49.879 INFO 34018 --- [ocp-schedules-22,19132949b7b6d2f0,9bd73a55d4ff2a68] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[10.79.169.37, 10.79.169.38, 10.79.169.36] 2024-12-31 18:34:49.879 INFO 34018 --- [ocp-schedules-22,19132949b7b6d2f0,9bd73a55d4ff2a68] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=2 2024-12-31 18:34:49.879 INFO 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=1 2024-12-31 18:34:49.879 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=3 2024-12-31 18:34:49.893 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:34:49.893 INFO 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:34:49.893 INFO 34018 --- [ocp-schedules-22,19132949b7b6d2f0,9bd73a55d4ff2a68] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:34:49.896 WARN 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:34:49.896 WARN 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:34:49.896 WARN 34018 --- [ocp-schedules-22,19132949b7b6d2f0,9bd73a55d4ff2a68] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:34:49.897 INFO 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:34:49.897 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:34:49.897 INFO 34018 --- [ocp-schedules-22,19132949b7b6d2f0,9bd73a55d4ff2a68] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:34:49.900 WARN 34018 --- [ocp-schedules-22,19132949b7b6d2f0,9bd73a55d4ff2a68] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:34:49.900 WARN 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:34:49.900 WARN 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:34:49.910 INFO 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.37:62889/api/v1/log/alarms, params:null 2024-12-31 18:34:49.910 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.36:62889/api/v1/log/alarms, params:null 2024-12-31 18:34:49.911 INFO 34018 --- [ocp-schedules-22,19132949b7b6d2f0,9bd73a55d4ff2a68] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.38:62889/api/v1/log/alarms, params:null 2024-12-31 18:34:49.918 ERROR 34018 --- [ocp-schedules-22,19132949b7b6d2f0,9bd73a55d4ff2a68] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task java.lang.RuntimeException: java.lang.reflect.InvocationTargetException at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:79) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) ... 10 common frames omitted Caused by: com.oceanbase.ocp.executor.exception.HttpConnectFailedException: connect to agent failed, ConnectException: Connection refused (Connection refused) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.safeExecute(HttpTemplate.java:498) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.doGet(HttpTemplate.java:217) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.get(HttpTemplate.java:82) at com.oceanbase.ocp.executor.executor.MonitorExecutor.getAlarms(MonitorExecutor.java:51) at com.oceanbase.ocp.compute.agent.manager.HostAgentAlarmManagerImpl.getHostAgentAlarms(HostAgentAlarmManagerImpl.java:62) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl.getHostAgentAlarmsByHost(HostAgentServiceImpl.java:1086) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl$$FastClassBySpringCGLIB$$e7947c56.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl$$EnhancerBySpringCGLIB$$b664ab35.getHostAgentAlarmsByHost() at com.oceanbase.ocp.server.common.scheduled.HostSchedules.lambda$getHostAgentAlarms$1(HostSchedules.java:105) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:731) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Caused by: javax.ws.rs.ProcessingException: org.apache.http.conn.HttpHostConnectException: Connect to 10.79.169.37:62889 [/10.79.169.37] failed: Connection refused (Connection refused) at org.glassfish.jersey.apache.connector.ApacheConnector.apply(ApacheConnector.java:519) at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:297) at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$2(JerseyInvocation.java:687) at org.glassfish.jersey.client.JerseyInvocation.call(JerseyInvocation.java:697) at org.glassfish.jersey.client.JerseyInvocation.lambda$runInScope$3(JerseyInvocation.java:691) at org.glassfish.jersey.internal.Errors.process(Errors.java:292) at org.glassfish.jersey.internal.Errors.process(Errors.java:274) at org.glassfish.jersey.internal.Errors.process(Errors.java:205) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:390) at org.glassfish.jersey.client.JerseyInvocation.runInScope(JerseyInvocation.java:691) at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:686) at org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:432) at org.glassfish.jersey.client.JerseyInvocation$Builder.get(JerseyInvocation.java:323) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.lambda$doGet$0(HttpTemplate.java:217) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.safeExecute(HttpTemplate.java:489) ... 21 common frames omitted Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 10.79.169.37:62889 [/10.79.169.37] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:72) at org.glassfish.jersey.apache.connector.ApacheConnector.apply(ApacheConnector.java:471) ... 35 common frames omitted Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 44 common frames omitted 2024-12-31 18:34:50.616 WARN 34018 --- [ocp-async-7,1217151fe0abb0fb,12c05623ff04c576] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:50.624 INFO 34018 --- [ocp-async-5,291f403958cd68da,1e7d6d7d775d0cd0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:51.568 INFO 34018 --- [prometheus-minute-schedule-1,28e2731d06a140ee,e4296aafa2d8c185] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:51.890 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:34:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:34:52.436 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:52.438 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:52.616 WARN 34018 --- [ocp-async-8,4b15c8fa5587782e,edd32331d3d26153] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:52.624 INFO 34018 --- [ocp-async-1,1d7dbdcb93b30710,deb2a8a8f394312e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:53.634 INFO 34018 --- [ocp-schedules-5,e6385cf83de95bff,517137f131463821] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:34:54.123 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,2d5dd9fd902c600d,27268847876b02d3] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/stats/topAvgCompactionDuration?limit=5&inDays=7, client=10.108.139.108, traceId=2d5dd9fd902c600d, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObClusterStatsController.getClustersTopAvgCompactionDuration(Integer,Integer), args=7,5,] 2024-12-31 18:34:54.133 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,d31b18ba2aba410a,c6f8792e41f86197] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters/tenants/topAvgCompactionDuration?limit=5&inDays=7, client=10.108.139.108, traceId=d31b18ba2aba410a, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObTenantCompactionController.topAvgCompactionDuration(Integer,Integer), args=7,5,] 2024-12-31 18:34:54.134 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,664bee26efa7f2fe,4a4da4296f60278a] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=664bee26efa7f2fe, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:34:54.136 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,664bee26efa7f2fe,4a4da4296f60278a] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=664bee26efa7f2fe, duration=8 ms] 2024-12-31 18:34:54.137 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,f9c843a16bfbd1d5,2746c2d7d44bb865] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=f9c843a16bfbd1d5, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:34:54.137 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,98f23c29aba7a2f6,87d213d7aac9879b] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=98f23c29aba7a2f6, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:34:54.138 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,98f23c29aba7a2f6,87d213d7aac9879b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=98f23c29aba7a2f6, duration=6 ms] 2024-12-31 18:34:54.140 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,57752ba26e3989f4,60fe222fe22cfb03] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=57752ba26e3989f4, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:34:54.141 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,57752ba26e3989f4,60fe222fe22cfb03] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=57752ba26e3989f4, duration=6 ms] 2024-12-31 18:34:54.141 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,f9c843a16bfbd1d5,2746c2d7d44bb865] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=f9c843a16bfbd1d5, duration=10 ms] 2024-12-31 18:34:54.161 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,7a3e6502c950b27b,714e935c75e2b2cd] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/cluster/resources?metrics=ob_cpu_assigned_percentage&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id, client=10.108.139.108, traceId=7a3e6502c950b27b, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewClusterResources(String,String,String,Integer), args=ob_cpu_assigned_percentage,app,ob_cluster_name,ob_cluster_id,app:OB,5,] 2024-12-31 18:34:54.162 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,e90fe7fc8c82a9af,236326a5c4007ac7] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/metricGroups?scope=OVERVIEW_HOST&type=TOP, client=10.108.139.108, traceId=e90fe7fc8c82a9af, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.MonitorController.listMetricClasses(Pageable,MetricType,MetricScope,Long), args=Page request [number: 0, size 5000, sort: id: ASC],TOP,OVERVIEW_HOST,] 2024-12-31 18:34:54.162 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,89fe94d49b25a05d,f97c9fb428a6222d] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/metricGroups?scope=OVERVIEW_ODP&type=TOP, client=10.108.139.108, traceId=89fe94d49b25a05d, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.MonitorController.listMetricClasses(Pageable,MetricType,MetricScope,Long), args=Page request [number: 0, size 5000, sort: id: ASC],TOP,OVERVIEW_ODP,] 2024-12-31 18:34:54.164 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,3ae7c17ef1f0db76,23de73c1aea89936] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/monitor/metricGroups?scope=OVERVIEW_TENANT&type=TOP, client=10.108.139.108, traceId=3ae7c17ef1f0db76, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.MonitorController.listMetricClasses(Pageable,MetricType,MetricScope,Long), args=Page request [number: 0, size 5000, sort: id: ASC],TOP,OVERVIEW_TENANT,] 2024-12-31 18:34:54.173 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,7a3e6502c950b27b,714e935c75e2b2cd] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/cluster/resources client=10.108.139.108, traceId=7a3e6502c950b27b, duration=16 ms] 2024-12-31 18:34:54.178 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,89fe94d49b25a05d,f97c9fb428a6222d] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/metricGroups client=10.108.139.108, traceId=89fe94d49b25a05d, duration=23 ms] 2024-12-31 18:34:54.179 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,2d5dd9fd902c600d,27268847876b02d3] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/stats/topAvgCompactionDuration client=10.108.139.108, traceId=2d5dd9fd902c600d, duration=66 ms] 2024-12-31 18:34:54.181 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,e90fe7fc8c82a9af,236326a5c4007ac7] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/metricGroups client=10.108.139.108, traceId=e90fe7fc8c82a9af, duration=26 ms] 2024-12-31 18:34:54.185 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,3ae7c17ef1f0db76,23de73c1aea89936] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/monitor/metricGroups client=10.108.139.108, traceId=3ae7c17ef1f0db76, duration=28 ms] 2024-12-31 18:34:54.185 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,d31b18ba2aba410a,c6f8792e41f86197] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters/tenants/topAvgCompactionDuration client=10.108.139.108, traceId=d31b18ba2aba410a, duration=59 ms] 2024-12-31 18:34:54.195 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,d92e19da54ea9ff4,35ad697a3c121f62] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/cluster/resources?metrics=ob_disk_used_percentage&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id, client=10.108.139.108, traceId=d92e19da54ea9ff4, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewClusterResources(String,String,String,Integer), args=ob_disk_used_percentage,app,ob_cluster_name,ob_cluster_id,app:OB,5,] 2024-12-31 18:34:54.203 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,d92e19da54ea9ff4,35ad697a3c121f62] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/cluster/resources client=10.108.139.108, traceId=d92e19da54ea9ff4, duration=15 ms] 2024-12-31 18:34:54.232 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,7a2d4193a48f2a82,cd4d718477927e99] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/cluster/resources?metrics=ob_memory_assigned_percentage&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id, client=10.108.139.108, traceId=7a2d4193a48f2a82, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewClusterResources(String,String,String,Integer), args=ob_memory_assigned_percentage,app,ob_cluster_name,ob_cluster_id,app:OB,5,] 2024-12-31 18:34:54.232 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,ae3766446b8fa542,baa780d4e91b3147] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/tenant/resources?metrics=ob_cpu_percent&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id%2Ctenant_name, client=10.108.139.108, traceId=ae3766446b8fa542, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewTenantResources(String,String,String,Integer), args=ob_cpu_percent,app,ob_cluster_name,ob_cluster_id,tenant_name,app:OB,5,] 2024-12-31 18:34:54.232 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,f95a9c9728774c6a,b3be7b88e5c973c5] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/tenant/resources?metrics=ob_memory_percent&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id%2Ctenant_name, client=10.108.139.108, traceId=f95a9c9728774c6a, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewTenantResources(String,String,String,Integer), args=ob_memory_percent,app,ob_cluster_name,ob_cluster_id,tenant_name,app:OB,5,] 2024-12-31 18:34:54.233 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,ab34a8dac389cbc9,95b4641172bdd263] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/tenant/resources?metrics=ob_tenant_disk_usage_v4&labels=app%3AOB&groupBy=app%2Cob_cluster_name%2Cob_cluster_id%2Ctenant_name, client=10.108.139.108, traceId=ab34a8dac389cbc9, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewTenantResources(String,String,String,Integer), args=ob_tenant_disk_usage_v4,app,ob_cluster_name,ob_cluster_id,tenant_name,app:OB,5,] 2024-12-31 18:34:54.233 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,3b09611fcc1056d9,7e68c2e4017e6bd2] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/ob/clusters?foldStandby=false, client=10.108.139.108, traceId=3b09611fcc1056d9, method=PaginatedResponse com.oceanbase.ocp.server.common.controller.ObClusterController.listObClusters(String,List,boolean,Boolean,WithRemote,List,Pageable), args=false,NONE,Page request [number: 0, size 5000, sort: name: ASC,obClusterId: ASC],] 2024-12-31 18:34:54.237 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,ae3766446b8fa542,baa780d4e91b3147] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/tenant/resources client=10.108.139.108, traceId=ae3766446b8fa542, duration=11 ms] 2024-12-31 18:34:54.238 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,f95a9c9728774c6a,b3be7b88e5c973c5] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/tenant/resources client=10.108.139.108, traceId=f95a9c9728774c6a, duration=12 ms] 2024-12-31 18:34:54.238 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,ab34a8dac389cbc9,95b4641172bdd263] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/tenant/resources client=10.108.139.108, traceId=ab34a8dac389cbc9, duration=10 ms] 2024-12-31 18:34:54.240 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,7a2d4193a48f2a82,cd4d718477927e99] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/cluster/resources client=10.108.139.108, traceId=7a2d4193a48f2a82, duration=15 ms] 2024-12-31 18:34:54.254 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,3b09611fcc1056d9,7e68c2e4017e6bd2] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/ob/clusters client=10.108.139.108, traceId=3b09611fcc1056d9, duration=26 ms] 2024-12-31 18:34:54.568 INFO 34018 --- [prometheus-minute-schedule-1,eb6d54bb8c28e3c5,9b980bb1735c43eb] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:54.617 WARN 34018 --- [ocp-async-9,ec92429afc4d49d1,32f15ab23f6f4ce1] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:54.625 INFO 34018 --- [ocp-async-10,6ef13aa3d5400669,19b4563831dc99a8] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:55.439 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:55.440 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:56.625 INFO 34018 --- [ocp-async-7,2834a9cb60d18770,80c871e35f222293] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:56.634 WARN 34018 --- [ocp-async-6,6231e9b1f7f27c6b,96a563bef9741b3c] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:57.568 INFO 34018 --- [prometheus-minute-schedule-1,25840abbeadec0aa,c43ea26babf3ce27] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641300, interval=60 2024-12-31 18:34:57.887 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.s.common.scheduled.OcpSchedules : Refresh OCP properties. 2024-12-31 18:34:57.887 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.ocp.core.property.PropertyService : Refresh config properties 2024-12-31 18:34:57.895 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:34:57.895 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:34:57.895 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:34:57.895 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:34:57.902 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : new: [] 2024-12-31 18:34:57.902 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : init spring 2024-12-31 18:34:57.902 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : have already run initialize. 2024-12-31 18:34:57.902 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : starting 2024-12-31 18:34:57.941 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:34:57.948 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:34:57.949 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:34:57.949 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:34:57.949 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:34:57.949 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:34:57.956 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:34:58.430 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.DataSourceInterceptor : dataSource dataSource already initialized. skipped. class: org.springframework.jdbc.datasource.DriverManagerDataSource 2024-12-31 18:34:58.441 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:34:58.442 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:34:58.465 INFO 34018 --- [ocp-schedules-12,6da81e609a106c5c,d2795137da1cf13a] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2024-12-31 18:34:58.465 INFO 34018 --- [ocp-schedules-26,5342b2a0d2270403,0cfdb94d940ab61b] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:34:58.472 INFO 34018 --- [ocp-schedules-4,b30510ea236c7957,eca6584aae3833d0] .o.o.s.t.b.c.AbstractShardingClusterTask : Check root service executed completed, allCount=1, successCount=1 2024-12-31 18:34:58.509 INFO 34018 --- [ocp-async-5,72a3a77de96369e6,da892ed52c7aec5d] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:34:58.588 INFO 34018 --- [ocp-schedules-3,3ca07e662607d860,61f60b50a73a0de3] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:34:58.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:34:58.588675+08:00, lastProcessTime=2024-12-31T18:34:48.588184+08:00 2024-12-31 18:34:58.625 INFO 34018 --- [ocp-async-1,aa5aeac8e329bdaa,edee701f75b77634] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:34:58.634 WARN 34018 --- [ocp-async-9,2f2706556d1b45f4,0b963003a4a26742] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:34:58.734 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:34:58.588675+08:00 2024-12-31 18:34:58.936 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT1.034183405S 2024-12-31 18:34:58.936 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : environmentPrepared 2024-12-31 18:34:59.026 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [config/ocp.yaml]' via location 'classpath:/config/' 2024-12-31 18:34:59.026 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] o.s.c.c.s.e.NativeEnvironmentRepository : Adding property source: Config resource 'class path resource [application.properties]' via location 'classpath:/' 2024-12-31 18:34:59.060 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] b.c.PropertySourceBootstrapConfiguration : Located property source: [BootstrapPropertySource {name='bootstrapProperties-classpath:/config/ocp.yaml'}, BootstrapPropertySource {name='bootstrapProperties-classpath:/application.properties'}, BootstrapPropertySource {name='bootstrapProperties-ocp-default'}] 2024-12-31 18:34:59.110 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : contextPrepared 2024-12-31 18:34:59.110 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : set internal properties as the first PropertySource 2024-12-31 18:34:59.110 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : register bean ProgressHandler 2024-12-31 18:34:59.110 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : set internal property ocp.version to 4.3.2 2024-12-31 18:34:59.110 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : ocp.version in spring: 4.3.2 2024-12-31 18:34:59.110 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] o.s.boot.SpringApplication : The following 1 profile is active: "composite" 2024-12-31 18:34:59.120 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : contextLoaded 2024-12-31 18:34:59.264 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] o.s.boot.SpringApplication : Started application in 1.369 seconds (JVM running for 1055.112) 2024-12-31 18:34:59.264 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.o.b.spring.BootstrapRunListener : ready. time taken: PT1.369376917S 2024-12-31 18:34:59.680 INFO 34018 --- [ocp-schedules-17,72cd96debd4ab944,37c0eae5d1703bf1] c.o.ocp.core.property.PropertyService : Refresh config properties done 2024-12-31 18:35:00.146 INFO 34018 --- [task-coordinator3,93cfe403787200b1,6c1e972c218c5a85] c.o.o.c.t.engine.util.SpringScheduler : Schedule time arrived, lastRun=2024-12-31 18:30:00.0, nextRun=2024-12-31 18:35:00.0, currentDate=Tue Dec 31 18:35:00 CST 2024 2024-12-31 18:35:00.146 INFO 34018 --- [task-coordinator3,93cfe403787200b1,6c1e972c218c5a85] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Schedule ready task, entity=TaskDefinitionEntity{id=999985, name=SqlParseSchedule, templateName=SqlParseSchedule, scheduleRule=0 */5 * * * *, lastRunTime=2024-12-31 18:30:00.0, nextRunTime=2024-12-31 18:35:00.0} 2024-12-31 18:35:00.192 INFO 34018 --- [task-coordinator3,93cfe403787200b1,6c1e972c218c5a85] c.o.o.p.s.internal.SqlParseTaskSchedule : get Clusters for parse:[] 2024-12-31 18:35:00.238 INFO 34018 --- [task-coordinator3,93cfe403787200b1,6c1e972c218c5a85] c.o.o.p.s.internal.SqlParseTaskSchedule : No tenant found, skip current task 2024-12-31 18:35:00.238 INFO 34018 --- [task-coordinator3,93cfe403787200b1,6c1e972c218c5a85] c.o.o.c.t.e.c.worker.ReadyTaskWorker : Task is not ready for schedule, taskName=SqlParseSchedule 2024-12-31 18:35:00.568 INFO 34018 --- [prometheus-minute-schedule-1,8a360beca771fd85,1f9e9b65e413cf1c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:00.625 INFO 34018 --- [ocp-async-10,94da1cb991856480,809697e22a20804b] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:00.634 WARN 34018 --- [ocp-async-2,7c7061d3ac1b3abe,232968659394adcc] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:01.442 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:01.444 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:02.625 INFO 34018 --- [ocp-async-7,8078cc25435062eb,1b572a9ffba3a073] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:02.635 WARN 34018 --- [ocp-async-5,0fc41802d1e64ca3,d984347d6c995252] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:03.568 INFO 34018 --- [prometheus-minute-schedule-1,2567d52bcfebf70e,e906b4f9e34e7499] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:03.688 INFO 34018 --- [ocp-schedules-25,000d203044b9b211,83bec3da6c5eb8e0] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:35:04.444 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:04.446 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:04.625 INFO 34018 --- [ocp-async-3,2064e886d94c3666,65baeec49c03ddd7] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:04.635 WARN 34018 --- [ocp-async-9,7fa1df444ce37f89,d8f99d43092a73ba] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:06.568 INFO 34018 --- [prometheus-minute-schedule-1,1c756f655a801353,811a6d2aa41e505f] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:06.626 INFO 34018 --- [ocp-async-4,9dba293322841113,1796c64ac87af487] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:06.635 WARN 34018 --- [ocp-async-2,0ca5755d1edf9ac7,203a5e5591c76e47] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:07.446 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:07.447 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:08.509 INFO 34018 --- [ocp-async-4,358872779b264778,9b270448104c288e] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:35:08.590 INFO 34018 --- [ocp-schedules-4,a8b8a2b5b4e53cba,e84723db694042dd] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:35:08.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:35:08.590206+08:00, lastProcessTime=2024-12-31T18:34:58.588675+08:00 2024-12-31 18:35:08.626 INFO 34018 --- [ocp-async-5,4f0585986f283026,0ae81801d1869ebf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:08.635 WARN 34018 --- [ocp-async-7,e505c495ed0eff79,5c4d6d5407131b5d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:08.770 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:35:08.590206+08:00 2024-12-31 18:35:09.479 INFO 34018 --- [ocp-schedules-21,2bd2d5c360d4f6c3,a01f77c3738d9004] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:35:09.489 INFO 34018 --- [ocp-schedules-21,2bd2d5c360d4f6c3,a01f77c3738d9004] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:35:09.489 INFO 34018 --- [ocp-schedules-21,2bd2d5c360d4f6c3,a01f77c3738d9004] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:35:09.568 INFO 34018 --- [prometheus-minute-schedule-1,5f8f6f364c9fff04,c53875cfaec5e676] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:10.004 INFO 34018 --- [ocp-schedules-17,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:35:10.004 INFO 34018 --- [ocp-schedules-7,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:35:10.447 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:10.449 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:10.626 INFO 34018 --- [ocp-async-9,fc71076cdc794c41,735ba9a95c8fc753] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:10.635 WARN 34018 --- [ocp-async-3,aa209a239a93551f,1e38983996b10b7d] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:10.922 WARN 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = ob_memory_percent,ob_tenant_cpu_percent,ob_tenant_disk_usage_v4, label = app=OB, gbLabel = app, ob_cluster_name, ob_cluster_id, tenant_name 2024-12-31 18:35:10.922 WARN 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = sql_all_count,sql_select_count,sql_insert_count,sql_update_count,sql_replace_count,sql_delete_count,sql_other_count,sql_all_rt,sql_select_rt,sql_insert_rt,sql_update_rt,sql_replace_rt,sql_delete_rt,sql_other_rt,sql_local_count,sql_remote_count,sql_distributed_count,sql_local_time,sql_remote_time,sql_distributed_time,active_session,all_session,wait_event_count,system_event_application_total_waits,system_event_configuration_total_waits,system_event_administrative_total_waits,system_event_concurrency_total_waits,system_event_commit_total_waits,system_event_network_total_waits,system_event_user_io_total_waits,system_event_system_io_total_waits,system_event_cluster_total_waits,system_event_other_total_waits,wait_event_rt,system_event_application_time_waited,system_event_configuration_time_waited,system_event_administrative_time_waited,system_event_concurrency_time_waited,system_event_commit_time_waited,system_event_network_time_waited,system_event_user_io_time_waited,system_event_system_io_time_waited,system_event_cluster_time_waited,system_event_other_time_waited,request_enqueue_count,request_dequeue_count,request_queue_time,ob_tenant_cpu_percent,ob_tenant_thread_percent,ob_memory_percent,memstore_percent,rpc_packet_in_rt,rpc_packet_out_rt,rpc_packet_in,rpc_packet_out,opened_cursors_count,max_full_clog_sync_delay_seconds,max_readonly_clog_sync_delay_seconds,max_logonly_clog_sync_delay_seconds,tps,transaction_commit_count,transaction_rollback_count,transaction_timeout_count,trans_sp_total_used_time,trans_distributed_total_used_time,tps_rt,transaction_commit_rt,transaction_rollback_rt,trans_commit_log_count,clog_trans_log_total_size,trans_commit_log_sync_rt,clog_write_disk_rt,memstore_write_lock_succ_count,memstore_write_lock_fail_count,memstore_write_lock_wait_time,transaction_single_partition_count,transaction_multi_partition_count,total_memstore_used,active_memstore_used,major_freeze_trigger,memstore_limit,io_read_count,io_write_count,io_read_rt,io_write_rt,io_read_size,io_writ 2024-12-31 18:35:10.923 INFO 34018 --- [async-queue-offer-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 60, queue size = 1, ruleSize = 1. 2024-12-31 18:35:10.930 WARN 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = ob_memory_percent,ob_tenant_cpu_percent,ob_tenant_disk_usage_v4, label = app=OB, gbLabel = app, ob_cluster_name, ob_cluster_id, tenant_name 2024-12-31 18:35:10.930 WARN 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.s.ShardingRecordingRulesHelper : Cannot match label for rule. metrics = sql_all_count,sql_select_count,sql_insert_count,sql_update_count,sql_replace_count,sql_delete_count,sql_other_count,sql_all_rt,sql_select_rt,sql_insert_rt,sql_update_rt,sql_replace_rt,sql_delete_rt,sql_other_rt,sql_local_count,sql_remote_count,sql_distributed_count,sql_local_time,sql_remote_time,sql_distributed_time,active_session,all_session,wait_event_count,system_event_application_total_waits,system_event_configuration_total_waits,system_event_administrative_total_waits,system_event_concurrency_total_waits,system_event_commit_total_waits,system_event_network_total_waits,system_event_user_io_total_waits,system_event_system_io_total_waits,system_event_cluster_total_waits,system_event_other_total_waits,wait_event_rt,system_event_application_time_waited,system_event_configuration_time_waited,system_event_administrative_time_waited,system_event_concurrency_time_waited,system_event_commit_time_waited,system_event_network_time_waited,system_event_user_io_time_waited,system_event_system_io_time_waited,system_event_cluster_time_waited,system_event_other_time_waited,request_enqueue_count,request_dequeue_count,request_queue_time,ob_tenant_cpu_percent,ob_tenant_thread_percent,ob_memory_percent,memstore_percent,rpc_packet_in_rt,rpc_packet_out_rt,rpc_packet_in,rpc_packet_out,opened_cursors_count,max_full_clog_sync_delay_seconds,max_readonly_clog_sync_delay_seconds,max_logonly_clog_sync_delay_seconds,tps,transaction_commit_count,transaction_rollback_count,transaction_timeout_count,trans_sp_total_used_time,trans_distributed_total_used_time,tps_rt,transaction_commit_rt,transaction_rollback_rt,trans_commit_log_count,clog_trans_log_total_size,trans_commit_log_sync_rt,clog_write_disk_rt,memstore_write_lock_succ_count,memstore_write_lock_fail_count,memstore_write_lock_wait_time,transaction_single_partition_count,transaction_multi_partition_count,total_memstore_used,active_memstore_used,major_freeze_trigger,memstore_limit,io_read_count,io_write_count,io_read_rt,io_write_rt,io_read_size,io_writ 2024-12-31 18:35:10.930 INFO 34018 --- [async-queue-offer-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Offer async queue, interval = 5, queue size = 5, ruleSize = 5. 2024-12-31 18:35:11.190 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,73870dc6d7c2be53,9b4b9bb0b7a3d95f] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=73870dc6d7c2be53, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:35:11.190 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,73aee7acab5411a7,20c2ceb335d9463b] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=73aee7acab5411a7, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:35:11.190 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,33ac81d195cbe6d4,467813e33632fd45] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=33ac81d195cbe6d4, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:35:11.190 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,a8555d6c7ecb269c,2b366e5d86cf24ed] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=a8555d6c7ecb269c, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:35:11.192 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,a8555d6c7ecb269c,2b366e5d86cf24ed] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=a8555d6c7ecb269c, duration=15 ms] 2024-12-31 18:35:11.192 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,33ac81d195cbe6d4,467813e33632fd45] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=33ac81d195cbe6d4, duration=17 ms] 2024-12-31 18:35:11.192 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,73870dc6d7c2be53,9b4b9bb0b7a3d95f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=73870dc6d7c2be53, duration=16 ms] 2024-12-31 18:35:11.196 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,73aee7acab5411a7,20c2ceb335d9463b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=73aee7acab5411a7, duration=22 ms] 2024-12-31 18:35:12.568 INFO 34018 --- [prometheus-minute-schedule-1,781685e9263ce25c,3e9d9fd8d1f60ac7] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:12.569 INFO 34018 --- [prometheus-hour-schedule-1,ed39f966eb37d4bb,5f4cc937681b89ef] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735642800, interval=3600 2024-12-31 18:35:12.626 INFO 34018 --- [ocp-async-2,adb501ca94a62f93,7b7cc972786beaa4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:12.635 WARN 34018 --- [ocp-async-4,f70d81ab0b89ddb3,c0ded64edd36cbdf] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:12.732 INFO 34018 --- [metric-archive-second-34,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641240, nodeCount=185, affectRows=185 2024-12-31 18:35:12.733 INFO 34018 --- [metric-archive-second-8,,] c.o.o.m.service.OcpMetricArchiveService : Second type metric archive, timestamp=1735641240, nodeCount=202, affectRows=202 2024-12-31 18:35:12.734 INFO 34018 --- [metric-archive-second-34,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641240, nodeCount=183, validCount=183 2024-12-31 18:35:12.734 INFO 34018 --- [metric-archive-second-8,,] c.o.o.m.service.OcpMetricArchiveService : Rollup second to minute, timestamp=1735641240, nodeCount=201, validCount=201 2024-12-31 18:35:13.449 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:13.452 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:13.735 INFO 34018 --- [ocp-schedules-19,72613b18107c5999,74c5f62a4365e415] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:35:14.370 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,d7e09abd7ee8ebe2,9896e315380429a9] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=d7e09abd7ee8ebe2, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:35:14.370 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,82444da0c9481f6c,e35ce0502bfeb318] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=82444da0c9481f6c, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:35:14.371 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,82444da0c9481f6c,e35ce0502bfeb318] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=82444da0c9481f6c, duration=7 ms] 2024-12-31 18:35:14.373 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,f5a1ddb45c8aa46b,24ce62dff4a37ea7] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=f5a1ddb45c8aa46b, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:35:14.373 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,a652a96e9a35cc91,2628c4eeb8fc3566] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=a652a96e9a35cc91, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:35:14.373 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,f5a1ddb45c8aa46b,24ce62dff4a37ea7] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=f5a1ddb45c8aa46b, duration=6 ms] 2024-12-31 18:35:14.374 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-1,a652a96e9a35cc91,2628c4eeb8fc3566] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=a652a96e9a35cc91, duration=6 ms] 2024-12-31 18:35:14.375 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-3,d7e09abd7ee8ebe2,9896e315380429a9] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=d7e09abd7ee8ebe2, duration=13 ms] 2024-12-31 18:35:14.626 INFO 34018 --- [ocp-async-6,e5406d3c896dcd5d,6f760ce7f95248ef] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:14.636 WARN 34018 --- [ocp-async-7,450573dc2bb8126d,25c103072f80691f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:15.568 INFO 34018 --- [prometheus-minute-schedule-1,d39a2f2c1569081b,fd6df1a24d724912] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:16.452 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:16.453 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:16.626 INFO 34018 --- [ocp-async-8,dd76b01e9aca6fc5,c02c145ba4b288be] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:16.636 WARN 34018 --- [ocp-async-3,8d02f8d37d438b98,e0419ab8b756a594] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:18.457 INFO 34018 --- [ocp-schedules-22,5634138d283ca56d,87c03901b578d0ff] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:35:18.458 INFO 34018 --- [ocp-schedules-5,a8a49003964631b8,48f32681ebf5a0e1] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:35:18.458 INFO 34018 --- [ocp-schedules-25,8a3d683d289197d6,299a830ea911df4b] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:35:18.463 INFO 34018 --- [ocp-schedules-5,a8a49003964631b8,48f32681ebf5a0e1] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:35:18.463 INFO 34018 --- [ocp-schedules-22,5634138d283ca56d,87c03901b578d0ff] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:35:18.464 INFO 34018 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : skip cluster not running and unavailable, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:35:18.465 INFO 34018 --- [ocp-schedules-9,68d4e34f622d5dea,0b120f422a8c4268] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:35:18.471 INFO 34018 --- [ocp-schedules-18,0b9fd754dc38140b,ffc4951c6cff7761] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:35:18.471 INFO 34018 --- [ocp-schedules-26,2194cf6035fb5e77,c32f704652b8b201] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:35:18.471 INFO 34018 --- [ocp-schedules-18,0b9fd754dc38140b,ffc4951c6cff7761] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:35:18.471 INFO 34018 --- [ocp-schedules-26,2194cf6035fb5e77,c32f704652b8b201] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:35:18.471 INFO 34018 --- [ocp-schedules-1,2a684c423c11f45f,e5c08408171a04ce] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:35:18.471 INFO 34018 --- [ocp-schedules-1,2a684c423c11f45f,e5c08408171a04ce] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:35:18.509 INFO 34018 --- [ocp-async-8,c3f2c2ad3a1d1a95,e5d5338045dcf8ec] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:35:18.568 INFO 34018 --- [prometheus-minute-schedule-1,479333f619792321,cd26f1e99e9545cc] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:18.584 INFO 34018 --- [ocp-schedules-24,5f175576826db6ae,857d230fb12a900e] c.o.o.s.c.scheduled.ClusterSchedules : Collect all cluster compaction info. 2024-12-31 18:35:18.588 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:35:18.588109+08:00, lastProcessTime=2024-12-31T18:35:08.590206+08:00 2024-12-31 18:35:18.589 INFO 34018 --- [ocp-schedules-24,5f175576826db6ae,857d230fb12a900e] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:35:18.589 INFO 34018 --- [Collect compaction for all clusters1,,] s.t.b.c.CollectAllClustersCompactionTask : Ob version >= 4.0.0.0, skip collect compaction 2024-12-31 18:35:18.593 INFO 34018 --- [ocp-schedules-10,95b419dce5c5ba7c,a4cf0a92f0733184] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:35:18.600 INFO 34018 --- [ocp-schedules-21,2508ae9084d13c75,42f17e1182044bbe] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:35:18.627 INFO 34018 --- [ocp-async-4,a85428293b748704,2fee3a2eed345a8c] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:18.636 WARN 34018 --- [ocp-async-2,c38513f6741318d7,324008b8af32bc8e] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:18.741 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:35:18.588109+08:00 2024-12-31 18:35:18.939 INFO 34018 --- [ocp-schedules-8,c1d8cc2b149c409c,ab2f4d12893ef8d6] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:35:18.940 INFO 34018 --- [ocp-schedules-8,5f0a0fba65b82760,a54b683d1115e305] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:35:18.946 INFO 34018 --- [ocp-schedules-8,5f0a0fba65b82760,a54b683d1115e305] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:35:18.995 INFO 34018 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] cluster is not accessible, skip sync cluster, clusterId=1, status=TAKINGOVER 2024-12-31 18:35:18.995 INFO 34018 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=false, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:35:19.454 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:19.456 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:20.627 INFO 34018 --- [ocp-async-7,7c00c3b6099a1a68,13f750c25ba715f1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:20.636 WARN 34018 --- [ocp-async-6,ee7365cb743da76d,6a86d4ad233e96e6] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:21.568 INFO 34018 --- [prometheus-minute-schedule-1,0fca32b780daa9c2,40631ddacf46ac8c] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:22.456 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:22.458 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:22.627 INFO 34018 --- [ocp-async-3,1a47c8b0c5c8bd5d,0ffe960dbf199baf] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:22.636 WARN 34018 --- [ocp-async-8,a713a3f486881566,e9f60173b243a927] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:23.008 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,9d9343d1c0670d61,2aca6f2642838782] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=9d9343d1c0670d61, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:35:23.010 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,c73ed414947f0661,1e71a3d7c70ce567] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=c73ed414947f0661, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:35:23.011 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,c73ed414947f0661,1e71a3d7c70ce567] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=c73ed414947f0661, duration=14 ms] 2024-12-31 18:35:23.013 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,9d9343d1c0670d61,2aca6f2642838782] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=9d9343d1c0670d61, duration=18 ms] 2024-12-31 18:35:23.016 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,1594668124c13056,a730c4fc1b008428] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=1594668124c13056, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:35:23.017 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,c6f6bafffe918aaa,e1839cabb8ca6208] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=c6f6bafffe918aaa, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:35:23.017 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-10,1594668124c13056,a730c4fc1b008428] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=1594668124c13056, duration=7 ms] 2024-12-31 18:35:23.017 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-8,c6f6bafffe918aaa,e1839cabb8ca6208] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=c6f6bafffe918aaa, duration=7 ms] 2024-12-31 18:35:23.789 INFO 34018 --- [ocp-schedules-16,757da02ced4c63d0,82647d6504a4a8fe] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:35:24.568 INFO 34018 --- [prometheus-minute-schedule-1,f4f59a368968d7e0,c2ba7215a424d8c9] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:24.627 INFO 34018 --- [ocp-async-1,f23130c5be007c8b,2eb830f0265be9f4] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:24.637 WARN 34018 --- [ocp-async-2,32b72714a83e1df2,fe49d7d91a682e34] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:25.458 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:25.460 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:26.627 INFO 34018 --- [ocp-async-10,77bf6cea9af82d13,55a96b46c06749b3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:26.637 WARN 34018 --- [ocp-async-6,0ed93709c9e57abf,650a48a87b6110be] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:27.568 INFO 34018 --- [prometheus-minute-schedule-1,f51b52839f991ac0,ab1e90caf5732e8d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:28.460 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:28.462 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:28.464 INFO 34018 --- [ocp-schedules-5,a8a49003964631b8,48f32681ebf5a0e1] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=1, successCount=1 2024-12-31 18:35:28.464 INFO 34018 --- [ocp-schedules-22,5634138d283ca56d,87c03901b578d0ff] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:35:28.509 INFO 34018 --- [ocp-async-6,c802cf1d919a60f5,37d631b602d6b039] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:35:28.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:35:28.588641+08:00, lastProcessTime=2024-12-31T18:35:18.588109+08:00 2024-12-31 18:35:28.589 INFO 34018 --- [ocp-schedules-24,5f175576826db6ae,857d230fb12a900e] .o.o.s.t.b.c.AbstractShardingClusterTask : Collect compaction for all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:35:28.595 INFO 34018 --- [ocp-schedules-27,ca2b68392bd9feb3,f9f0816d6d0751ca] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:35:28.628 INFO 34018 --- [ocp-async-5,6df27f34a78c5144,3d2f66cf3aacfb8a] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:28.637 WARN 34018 --- [ocp-async-3,cb3de6e7a0ded439,e1662b0e9379ec0f] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:28.766 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:35:28.588641+08:00 2024-12-31 18:35:29.492 INFO 34018 --- [ocp-schedules-12,98626d1f31c45db1,a2c5cdbf9887a6d3] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:35:29.501 INFO 34018 --- [ocp-schedules-12,98626d1f31c45db1,a2c5cdbf9887a6d3] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:35:29.501 INFO 34018 --- [ocp-schedules-12,98626d1f31c45db1,a2c5cdbf9887a6d3] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:35:30.568 INFO 34018 --- [prometheus-minute-schedule-1,45390dc0f28c9c9e,3cd1acab424db186] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:30.628 INFO 34018 --- [ocp-async-5,d533d9cf12f27c0d,6c44a484fc3beb19] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:30.637 WARN 34018 --- [ocp-async-1,e2280cdad951dd27,416d74da5dc94ebb] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:31.462 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:31.464 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:32.631 INFO 34018 --- [ocp-async-4,da4d098ec6f01178,bfe4f11ffde86d32] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:32.637 WARN 34018 --- [ocp-async-8,3bf0cee1d7c48363,0380d37134a0a699] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:33.147 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,99b098fde76c616a,f19fddcded06b095] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=99b098fde76c616a, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:35:33.147 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,bb30d0b93f3dc056,6e58440345956732] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=bb30d0b93f3dc056, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:35:33.147 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,bb30d0b93f3dc056,6e58440345956732] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=bb30d0b93f3dc056, duration=6 ms] 2024-12-31 18:35:33.148 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,2fc838eb6d2a216d,c8adbbc81e3e0840] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=2fc838eb6d2a216d, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:35:33.148 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,08fe7a4ef5fc27fd,0f39cf9cc20a52d5] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=08fe7a4ef5fc27fd, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:35:33.148 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-4,08fe7a4ef5fc27fd,0f39cf9cc20a52d5] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=08fe7a4ef5fc27fd, duration=5 ms] 2024-12-31 18:35:33.148 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,2fc838eb6d2a216d,c8adbbc81e3e0840] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=2fc838eb6d2a216d, duration=7 ms] 2024-12-31 18:35:33.150 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-9,99b098fde76c616a,f19fddcded06b095] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=99b098fde76c616a, duration=12 ms] 2024-12-31 18:35:33.568 INFO 34018 --- [prometheus-minute-schedule-1,fa0816ab80fc6a67,65d5209904821d84] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:33.835 INFO 34018 --- [ocp-schedules-25,3716995b7f1b052e,dc61188bb969bc72] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:35:34.464 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:34.467 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:34.632 INFO 34018 --- [ocp-async-3,8a15416a37ccac19,6963100451421144] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:34.637 WARN 34018 --- [ocp-async-7,79d79d1873d9645a,273f2c22c6d935a3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:36.509 INFO 34018 --- [pool-15-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_PERF_DIAGNOSER, Interval{start=2024-12-31T18:29:36.466, end=2024-12-31T18:34:36.501} 2024-12-31 18:35:36.509 INFO 34018 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : Starting SQL_INDEX_DIAGNOSER, Interval{start=2024-12-31T18:29:36.466, end=2024-12-31T18:34:36.505} 2024-12-31 18:35:36.520 INFO 34018 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER : for [] 2024-12-31 18:35:36.521 INFO 34018 --- [pool-15-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER : for [] 2024-12-31 18:35:36.521 INFO 34018 --- [pool-16-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_INDEX_DIAGNOSER, Found out 0 dubious sqls 2024-12-31 18:35:36.521 INFO 34018 --- [pool-15-thread-1,,] c.o.o.p.s.d.i.AbstractDiagnoseService : SQL_PERF_DIAGNOSER, Found out 0 dubious sqls 2024-12-31 18:35:36.568 INFO 34018 --- [prometheus-minute-schedule-1,7f63b58ccff8f5f9,0383d87cf21a0536] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:36.569 INFO 34018 --- [prometheus-cache-monitor1,92978285dba2a243,81a76f064645b44d] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1532,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":387,"seriesIdKeySize":387,"secondWriteQueue":0,"minuteWriteCacheSize":384} 2024-12-31 18:35:36.569 INFO 34018 --- [prometheus-cache-monitor1,92978285dba2a243,81a76f064645b44d] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=49, ob_cluster_status_check=7, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, ob_cluster_sync=6, http_server_requests_seconds_count=49, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:35:36.632 INFO 34018 --- [ocp-async-9,a4e8679dd38616b7,b9965f7a5e1b4181] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:36.638 WARN 34018 --- [ocp-async-2,ff7df028fa6a5bf5,c571628bbaf9fbba] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:37.467 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:37.469 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:38.510 INFO 34018 --- [ocp-async-1,e5a61868660af323,e63e765466975243] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:35:38.590 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:35:38.590274+08:00, lastProcessTime=2024-12-31T18:35:28.588641+08:00 2024-12-31 18:35:38.598 INFO 34018 --- [ocp-schedules-26,a76128a36a764055,012f5c4c4de8e953] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:35:38.632 INFO 34018 --- [ocp-async-10,0b1ed98379536a2d,0769a64047631e7f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:38.638 WARN 34018 --- [ocp-async-8,ac6bbfc0f1eaf34f,7eaacbefad7ddcd0] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:38.772 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:35:38.590274+08:00 2024-12-31 18:35:39.568 INFO 34018 --- [prometheus-minute-schedule-1,2a97d5c0e86e20dd,fe9ab33ae6dfa1b2] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:40.004 INFO 34018 --- [ocp-schedules-22,,] c.o.o.s.c.scheduled.ObproxySchedules : Collect obproxy metrics, size=0 2024-12-31 18:35:40.004 INFO 34018 --- [ocp-schedules-28,,] c.o.o.s.c.scheduled.ObproxySchedules : Check obproxy server stats, size=0 2024-12-31 18:35:40.469 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:40.471 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:40.632 INFO 34018 --- [ocp-async-7,9f9f38cf292bc8c1,8b63abfee569ae86] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:40.638 WARN 34018 --- [ocp-async-6,4fe5333d559763e4,9f7b29649d65cd20] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:42.568 INFO 34018 --- [prometheus-minute-schedule-1,cc003939062ef184,8d7d02f8fb4f5c9a] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:42.632 INFO 34018 --- [ocp-async-2,513cd6cc5214617d,e627cea64f0e1a07] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:42.638 WARN 34018 --- [ocp-async-9,317372ca21a65c47,9ef0833cbc548cee] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:43.283 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,1566c3fd59af942a,6eacae5eeb225c91] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=backup, client=10.108.139.108, traceId=1566c3fd59af942a, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[backup],] 2024-12-31 18:35:43.283 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,76257d77e5f52fd5,2a07277a3cc5c24b] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=cluster%2Ctenant%2Cobproxy%2Chost%2Calarm%2Ctask, client=10.108.139.108, traceId=76257d77e5f52fd5, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[cluster, tenant, obproxy, host, alarm, task],] 2024-12-31 18:35:43.283 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,38a9056af6b45ee5,10c9a24625b7acb7] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/status?modules=performance, client=10.108.139.108, traceId=38a9056af6b45ee5, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.getOverviewStatus(List), args=[performance],] 2024-12-31 18:35:43.285 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-5,1566c3fd59af942a,6eacae5eeb225c91] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=1566c3fd59af942a, duration=9 ms] 2024-12-31 18:35:43.285 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-2,38a9056af6b45ee5,10c9a24625b7acb7] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=38a9056af6b45ee5, duration=14 ms] 2024-12-31 18:35:43.288 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,4b3055eec8888ac4,9b64d7ea1ed2cf88] c.o.o.s.c.trace.RequestTracingAspect : API: [GET /api/v2/overview/resourceStats?modules=cluster, client=10.108.139.108, traceId=4b3055eec8888ac4, method=SuccessResponse com.oceanbase.ocp.server.common.controller.OcpOverviewController.resourceStatistic(List), args=[cluster],] 2024-12-31 18:35:43.289 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-6,4b3055eec8888ac4,9b64d7ea1ed2cf88] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/resourceStats client=10.108.139.108, traceId=4b3055eec8888ac4, duration=6 ms] 2024-12-31 18:35:43.289 INFO 34018 --- [http-nio-0.0.0.0-8090-exec-7,76257d77e5f52fd5,2a07277a3cc5c24b] c.o.o.s.c.trace.RequestTracingAspect : API OK: [GET /api/v2/overview/status client=10.108.139.108, traceId=76257d77e5f52fd5, duration=18 ms] 2024-12-31 18:35:43.471 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:43.473 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:43.887 INFO 34018 --- [ocp-schedules-24,1b35a506e28a21b0,3a29162d5026235f] c.o.ocp.alarm.core.task.AlarmDetectTask : alarm detect start 2024-12-31 18:35:44.633 INFO 34018 --- [ocp-async-8,14f180e2f0b57896,0dfdf9004b3c61e1] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:44.638 WARN 34018 --- [ocp-async-4,43eec4c58c39434e,bf2e7b459b8cc0c3] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:45.568 INFO 34018 --- [prometheus-minute-schedule-1,c8d06925dc843f54,67be58214676c0fe] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:46.473 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:46.475 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:46.633 INFO 34018 --- [ocp-async-10,b7d0a05247921abe,38a5b708fbace9ab] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:46.639 WARN 34018 --- [ocp-async-6,c9a49336ec03a596,d8d6f98fe37c46a7] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:48.456 INFO 34018 --- [ocp-schedules-6,9c7fb3a132cc2f7e,7c5d00774be079c2] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=BackupAlarmCheckSchedule, method=run 2024-12-31 18:35:48.457 INFO 34018 --- [ocp-schedules-30,f269c4dfe8dea111,ca4fca5dd361d6dc] c.o.o.s.c.scheduled.ClusterSchedules : Check cluster status schedule. 2024-12-31 18:35:48.457 INFO 34018 --- [ocp-schedules-1,769f3927fc7c5c90,c66211ab0e0c7700] c.o.o.s.c.scheduled.ClusterSchedules : Check standby cluster info schedule. 2024-12-31 18:35:48.459 INFO 34018 --- [ocp-schedules-3,81ecdcc8e0217f4b,5cc3cd8331283eb3] c.o.o.s.c.scheduled.TenantSchedules : Check all standby tenant 2024-12-31 18:35:48.459 INFO 34018 --- [ocp-schedules-15,10efa6e2495429a3,6af8cdd6930e3e7f] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] begin refresh method to audit event meta map... 2024-12-31 18:35:48.464 INFO 34018 --- [ocp-schedules-30,f269c4dfe8dea111,ca4fca5dd361d6dc] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:35:48.464 INFO 34018 --- [ocp-schedules-1,769f3927fc7c5c90,c66211ab0e0c7700] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:35:48.464 INFO 34018 --- [ocp-schedules-6,9c7fb3a132cc2f7e,7c5d00774be079c2] c.o.o.b.i.alarm.BackupAlarmService : Backup alarm check schedule. 2024-12-31 18:35:48.464 INFO 34018 --- [Check status for all clusters1,,] c.o.o.s.t.b.c.CheckClusterStatusTask : skip cluster not running and unavailable, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:35:48.465 INFO 34018 --- [ocp-schedules-16,0717eda2f165a0e7,99cc4350fe95a456] c.o.o.s.c.scheduled.ClusterSchedules : Check all arbitration services 2024-12-31 18:35:48.467 INFO 34018 --- [ocp-schedules-15,10efa6e2495429a3,6af8cdd6930e3e7f] c.o.ocp.service.audit.AuditEventService : [refreshMethodToAuditEventMetaIdMap] refresh method to audit event meta map success 2024-12-31 18:35:48.472 INFO 34018 --- [ocp-schedules-12,5d7688f64ea34638,68dc9932a424c4d9] c.o.o.s.common.scheduled.HostSchedules : Check host clockdiff schedule, hostIps=[] 2024-12-31 18:35:48.472 INFO 34018 --- [ocp-schedules-2,89a4cc260a0f5416,b900ae461168b980] c.o.o.s.common.scheduled.HostSchedules : Check host status schedule, hostIps=[] 2024-12-31 18:35:48.472 INFO 34018 --- [ocp-schedules-25,1275c0e75313f06b,88201ba6972a23a3] c.o.o.s.common.scheduled.HostSchedules : Check host agent status schedule, hostIps=[] 2024-12-31 18:35:48.472 INFO 34018 --- [ocp-schedules-25,1275c0e75313f06b,88201ba6972a23a3] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-agent-status, skip execute 2024-12-31 18:35:48.472 INFO 34018 --- [ocp-schedules-12,5d7688f64ea34638,68dc9932a424c4d9] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-clockdiff, skip execute 2024-12-31 18:35:48.472 INFO 34018 --- [ocp-schedules-2,89a4cc260a0f5416,b900ae461168b980] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=host-check-host-status, skip execute 2024-12-31 18:35:48.510 INFO 34018 --- [ocp-async-3,a85961955f93e391,2564ad1860824bc3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents 2024-12-31 18:35:48.517 INFO 34018 --- [ocp-schedules-19,9ab2daf291df6627,85793e7c58a937f1] c.o.o.m.s.OcpCacheMonitorServiceImpl : OcpCacheMonitor, cacheInfo={"secondReadCacheSize":1532,"minuteWriteQueue":0,"minuteReadCacheSize":0,"secondWriteCacheSize":387,"seriesIdKeySize":387,"secondWriteQueue":0,"minuteWriteCacheSize":384} 2024-12-31 18:35:48.517 INFO 34018 --- [ocp-schedules-19,9ab2daf291df6627,85793e7c58a937f1] c.o.o.m.s.OcpCacheMonitorServiceImpl : MetricSearchStats:{jvm_gc_max_data_size_bytes=2, http_server_requests_seconds_sum=49, ob_cluster_status_check=7, system_cpu_count=2, jvm_gc_pause_seconds_sum=6, jvm_threads_states_threads=8, ocp_alarm_detect_duration_ms_sum=131, jvm_memory_committed_bytes=10, jvm_gc_memory_promoted_bytes_total=2, jvm_threads_live_threads=2, ocp_meta_db_health=4, system_load_average_1m=2, jvm_gc_pause_seconds_max=6, system_cpu_usage=2, ob_cluster_sync=6, http_server_requests_seconds_count=49, jvm_gc_memory_allocated_bytes_total=2, jvm_gc_pause_seconds_count=6, jvm_threads_peak_threads=2, ocp_alarm_detect_duration_ms_count=131, jvm_gc_overhead_percent=2, jvm_memory_used_bytes=10, process_cpu_usage=2, jvm_memory_max_bytes=10} 2024-12-31 18:35:48.568 INFO 34018 --- [prometheus-minute-schedule-1,f4e6ef5820f026e2,20630efd80f4843e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:48.575 INFO 34018 --- [ocp-schedules-23,4579942f24309b75,6ecd28fe9e7917c1] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog instances, size=0 2024-12-31 18:35:48.579 INFO 34018 --- [ocp-schedules-7,66fcd44a0d126bb1,2011ec43f5ca2085] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict 2024-12-31 18:35:48.579 INFO 34018 --- [ocp-schedules-7,66fcd44a0d126bb1,2011ec43f5ca2085] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict. 2024-12-31 18:35:48.589 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2024-12-31T18:35:48.588568+08:00, lastProcessTime=2024-12-31T18:35:38.590274+08:00 2024-12-31 18:35:48.600 INFO 34018 --- [ocp-schedules-28,a584f639fbe7f16a,c1c89b844d0f898b] c.o.ocp.monitor.OcpMonitorManager : Refresh cached second exporters 2024-12-31 18:35:48.602 INFO 34018 --- [ocp-schedules-10,e4b079482bf0af6d,274499b6bdd48c51] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0 2024-12-31 18:35:48.620 INFO 34018 --- [ocp-schedules-14,341c9f10407c10bf,ab7814beae5b4c9a] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2024-12-31 18:35:48.622 INFO 34018 --- [ocp-schedules-14,341c9f10407c10bf,ab7814beae5b4c9a] c.o.o.a.service.OcpAlarmSearchService : alarmTargetStat [] 2024-12-31 18:35:48.633 INFO 34018 --- [ocp-async-5,4739686f4138e940,a0896def25951971] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:48.639 WARN 34018 --- [ocp-async-4,85ee551626b73a29,b1da10bd7e4ab549] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:48.639 INFO 34018 --- [ocp-schedules-4,428fa2af7d4b481e,8aef09e2dd4101de] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info 2024-12-31 18:35:48.647 INFO 34018 --- [ocp-schedules-4,428fa2af7d4b481e,8aef09e2dd4101de] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success. 2024-12-31 18:35:48.647 INFO 34018 --- [ocp-schedules-4,428fa2af7d4b481e,8aef09e2dd4101de] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 1 2024-12-31 18:35:48.717 INFO 34018 --- [ocp-schedules-27,e3645fd4fed36d1e,e4b0799fb0cd032e] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction 2024-12-31 18:35:48.717 INFO 34018 --- [ocp-schedules-27,e3645fd4fed36d1e,e4b0799fb0cd032e] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info 2024-12-31 18:35:48.720 INFO 34018 --- [ocp-schedules-6,49f71a2ba65df4fb,f2bc3c3afd262f77] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start. 2024-12-31 18:35:48.720 INFO 34018 --- [ocp-schedules-6,49f71a2ba65df4fb,f2bc3c3afd262f77] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=0 2024-12-31 18:35:48.726 INFO 34018 --- [ocp-schedules-5,6d21b2146586d58c,b8dee7f1983beec4] c.o.o.s.c.scheduled.ClusterSchedules : Sync root server list. 2024-12-31 18:35:48.727 INFO 34018 --- [ocp-schedules-6,49f71a2ba65df4fb,f2bc3c3afd262f77] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start. 2024-12-31 18:35:48.727 INFO 34018 --- [ocp-schedules-6,49f71a2ba65df4fb,f2bc3c3afd262f77] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730654274633891840 2024-12-31 18:35:48.730 INFO 34018 --- [ocp-schedules-5,6d21b2146586d58c,b8dee7f1983beec4] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:35:48.732 INFO 34018 --- [ocp-schedules-6,49f71a2ba65df4fb,f2bc3c3afd262f77] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start. 2024-12-31 18:35:48.732 INFO 34018 --- [ocp-schedules-6,49f71a2ba65df4fb,f2bc3c3afd262f77] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=730654881381908480 2024-12-31 18:35:48.758 INFO 34018 --- [ocp-schedules-27,e3645fd4fed36d1e,e4b0799fb0cd032e] o.o.c.t.e.u.DistributedExclusiveExecutor : Empty item list, taskName=Collect all tenants major compactions, skip execute 2024-12-31 18:35:48.758 INFO 34018 --- [ocp-schedules-27,e3645fd4fed36d1e,e4b0799fb0cd032e] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info 2024-12-31 18:35:48.761 INFO 34018 --- [ocp-schedules-22,b5716652f7f4adc3,f04d522422812644] c.o.o.s.common.scheduled.PerfSchedules : Oas sql curing, clusters=[] 2024-12-31 18:35:48.764 INFO 34018 --- [alarm-task-1,da7b9d19fa7301e0,626d861ab9a9911b] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2024-12-31T18:35:48.588568+08:00 2024-12-31 18:35:48.820 ERROR 34018 --- [ocp-schedules-5,6d21b2146586d58c,b8dee7f1983beec4] .o.o.s.t.b.c.AbstractShardingClusterTask : process cluster error java.util.concurrent.ExecutionException: com.oceanbase.ocp.service.profile.exception.CredentialMissingException: [OCP CredentialMissingException]: status=428 PRECONDITION_REQUIRED, errorCode=IAM_CREDENTIAL_REQUIRED, args=myoceanbase,sys,ocp_monitor at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.run(AbstractShardingClusterTask.java:77) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.run(AbstractShardingClusterTask.java:47) at com.oceanbase.ocp.server.common.scheduled.ClusterSchedules.syncRootServer(ClusterSchedules.java:85) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.oceanbase.ocp.service.profile.exception.CredentialMissingException: [OCP CredentialMissingException]: status=428 PRECONDITION_REQUIRED, errorCode=IAM_CREDENTIAL_REQUIRED, args=myoceanbase,sys,ocp_monitor at com.oceanbase.ocp.service.profile.exception.CredentialMissingException.ob(CredentialMissingException.java:34) at com.oceanbase.ocp.service.credential.CredentialServiceImpl.acquireJdbcPasswordInner(CredentialServiceImpl.java:166) at com.oceanbase.ocp.service.credential.CredentialServiceImpl.acquireObPassword(CredentialServiceImpl.java:143) at com.oceanbase.ocp.service.credential.CredentialServiceImpl$$FastClassBySpringCGLIB$$6855c59e.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.service.credential.CredentialServiceImpl$$EnhancerBySpringCGLIB$$16fc940d.acquireObPassword() at com.oceanbase.ocp.service.ob.obsdk.factory.ConnectPropertiesBuilder.acquirePassword(ConnectPropertiesBuilder.java:204) at com.oceanbase.ocp.service.ob.obsdk.factory.ConnectPropertiesBuilder.buildConnectProperties(ConnectPropertiesBuilder.java:97) at com.oceanbase.ocp.service.ob.obsdk.factory.AbstractObOperatorFactory.buildConnectProperties(AbstractObOperatorFactory.java:324) at com.oceanbase.ocp.service.ob.obsdk.factory.AbstractObOperatorFactory.createObOperator(AbstractObOperatorFactory.java:117) at com.oceanbase.ocp.service.task.business.cluster.RefreshRsListTask.getRsList(RefreshRsListTask.java:90) at com.oceanbase.ocp.service.task.business.cluster.RefreshRsListTask.processCluster(RefreshRsListTask.java:42) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.lambda$run$1(AbstractShardingClusterTask.java:70) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted 2024-12-31 18:35:48.820 INFO 34018 --- [ocp-schedules-5,6d21b2146586d58c,b8dee7f1983beec4] .o.o.s.t.b.c.AbstractShardingClusterTask : Refresh root service list executed completed, allCount=1, successCount=0 2024-12-31 18:35:48.821 INFO 34018 --- [ocp-schedules-17,a129de9ededa1ff6,010dd48857c4a1cb] c.o.o.s.common.scheduled.PerfSchedules : Collect slow sql for alarm, time=2024-12-31T18:35:48.821+08:00, clusters=[1] 2024-12-31 18:35:48.825 INFO 34018 --- [ocp-schedules-17,a129de9ededa1ff6,010dd48857c4a1cb] c.o.o.p.s.i.alarm.SlowSqlDataSource : query sqlCount of obCluster myoceanbase for slowSqlStat, sql count is 0. 2024-12-31 18:35:48.856 INFO 34018 --- [ocp-schedules-11,98e6155ff2b269dd,c83d03fdc4aac6b9] c.o.o.s.common.scheduled.PerfSchedules : Collect trans stat for alarm, time=2024-12-31T18:35:48.856+08:00, clusters=[1] 2024-12-31 18:35:48.858 INFO 34018 --- [ocp-schedules-11,98e6155ff2b269dd,c83d03fdc4aac6b9] c.o.o.p.t.i.alarm.TransStatDataSource : query trans stat of obCluster myoceanbase, trans stat result is empty. 2024-12-31 18:35:48.996 INFO 34018 --- [ocp-schedules-8,5f0a0fba65b82760,a54b683d1115e305] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=1, successCount=1 2024-12-31 18:35:48.996 INFO 34018 --- [ocp-schedules-8,97c49e5b65bd5479,00e92949fc5f8e7d] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule. 2024-12-31 18:35:49.001 INFO 34018 --- [ocp-schedules-8,97c49e5b65bd5479,00e92949fc5f8e7d] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:35:49.045 INFO 34018 --- [Sync all clusters1,,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] cluster is not accessible, skip sync cluster, clusterId=1, status=TAKINGOVER 2024-12-31 18:35:49.046 INFO 34018 --- [Sync all clusters1,,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=false, cluster=ObClusterOverview(id=1, name=myoceanbase, obClusterId=1735638920, vpcId=1, vpcName=system-default, type=PRIMARY, status=TAKINGOVER, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson=null, createTime=2024-12-31T18:30:49+08:00, creator=admin, obVersion=4.2.1.10, packageOperatingSystem=null, loadType=null, tenantCount=0) 2024-12-31 18:35:49.147 INFO 34018 --- [ocp-schedules-29,195f4bf07412e421,3e6d385d0774aaaf] c.o.o.s.c.scheduled.TenantSchedules : Sync all tenant info schedule. 2024-12-31 18:35:49.153 INFO 34018 --- [ocp-schedules-29,195f4bf07412e421,3e6d385d0774aaaf] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1] 2024-12-31 18:35:49.299 ERROR 34018 --- [Sync all tenant information1,,] c.o.ocp.core.util.ExceptionUtils : Checked Exception: com.oceanbase.ocp.core.exception.NotFoundException occurred with code error.ob.tenant.name.not.found, and args [myoceanbase, sys] 2024-12-31 18:35:49.301 ERROR 34018 --- [ocp-schedules-29,195f4bf07412e421,3e6d385d0774aaaf] .o.o.s.t.b.c.AbstractShardingClusterTask : process cluster error java.util.concurrent.ExecutionException: com.oceanbase.ocp.core.exception.NotFoundException: [OCP NotFoundException]: status=404 NOT_FOUND, errorCode=OB_TENANT_NAME_NOT_FOUND, args=myoceanbase,sys at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.run(AbstractShardingClusterTask.java:77) at com.oceanbase.ocp.server.common.scheduled.TenantSchedules.syncAllTenantInfo(TenantSchedules.java:43) at sun.reflect.GeneratedMethodAccessor851.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: com.oceanbase.ocp.core.exception.NotFoundException: [OCP NotFoundException]: status=404 NOT_FOUND, errorCode=OB_TENANT_NAME_NOT_FOUND, args=myoceanbase,sys at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at com.oceanbase.ocp.core.util.ExceptionUtils.newException(ExceptionUtils.java:96) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.lambda$getSysTenant$5(TenantDaoManagerImpl.java:171) at java.util.Optional.orElseThrow(Optional.java:290) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl.getSysTenant(TenantDaoManagerImpl.java:171) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$FastClassBySpringCGLIB$$f93ff265.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.obops.internal.tenant.TenantDaoManagerImpl$$EnhancerBySpringCGLIB$$a55dcec2.getSysTenant() at com.oceanbase.ocp.obops.internal.tenant.TenantSyncServiceImpl.markSysTenantUnavailable(TenantSyncServiceImpl.java:271) at com.oceanbase.ocp.service.task.business.tenant.SyncAllTenantInfoShardingTask.processCluster(SyncAllTenantInfoShardingTask.java:38) at com.oceanbase.ocp.service.task.business.cluster.AbstractShardingClusterTask.lambda$run$1(AbstractShardingClusterTask.java:70) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted 2024-12-31 18:35:49.301 INFO 34018 --- [ocp-schedules-29,195f4bf07412e421,3e6d385d0774aaaf] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all tenant information executed completed, allCount=1, successCount=0 2024-12-31 18:35:49.475 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:49.477 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:49.504 INFO 34018 --- [ocp-schedules-23,34b1ee72dfcd6e9c,dbc1d010dea41356] c.o.o.a.service.TaskRepositoryService : markNoHeartbeatToFailed success, affectRow=0 2024-12-31 18:35:49.514 INFO 34018 --- [ocp-schedules-23,34b1ee72dfcd6e9c,dbc1d010dea41356] c.o.o.a.service.TaskRepositoryService : heartbeat done, affectRow=1, taskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:35:49.514 INFO 34018 --- [ocp-schedules-23,34b1ee72dfcd6e9c,dbc1d010dea41356] c.o.o.alarm.utils.task.AlarmTaskManager : updateHeartbeat, tryCount=1, heartbeatCount=1, currentTaskUuidList=[05b0ee56-3bf6-4d1d-a3be-d1fe245934fa] 2024-12-31 18:35:49.931 INFO 34018 --- [ocp-schedules-6,e47efb57ff33b774,e5a5844112cf2f4a] c.o.o.s.common.scheduled.HostSchedules : Get host agent alarms, hostIps=[10.79.169.37, 10.79.169.38, 10.79.169.36] 2024-12-31 18:35:49.931 INFO 34018 --- [ocp-schedules-6,e47efb57ff33b774,e5a5844112cf2f4a] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=2 2024-12-31 18:35:49.931 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=1 2024-12-31 18:35:49.931 INFO 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.c.agent.HostAgentServiceImpl : Get OCP agent alarms: hostId=3 2024-12-31 18:35:49.944 INFO 34018 --- [ocp-schedules-6,e47efb57ff33b774,e5a5844112cf2f4a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:35:49.945 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:35:49.945 INFO 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:35:49.947 WARN 34018 --- [ocp-schedules-6,e47efb57ff33b774,e5a5844112cf2f4a] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:35:49.948 WARN 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:35:49.948 WARN 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:35:49.948 INFO 34018 --- [ocp-schedules-6,e47efb57ff33b774,e5a5844112cf2f4a] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2 2024-12-31 18:35:49.948 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1 2024-12-31 18:35:49.948 INFO 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=3 2024-12-31 18:35:49.951 WARN 34018 --- [ocp-schedules-6,e47efb57ff33b774,e5a5844112cf2f4a] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=2 2024-12-31 18:35:49.951 WARN 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=1 2024-12-31 18:35:49.952 WARN 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.c.agent.HostAgentServiceImpl : OCP agent not found: hostId=3 2024-12-31 18:35:49.959 INFO 34018 --- [ForkJoinPool.commonPool-worker-47,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.37:62889/api/v1/log/alarms, params:null 2024-12-31 18:35:49.959 INFO 34018 --- [ForkJoinPool.commonPool-worker-53,,] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.36:62889/api/v1/log/alarms, params:null 2024-12-31 18:35:49.959 INFO 34018 --- [ocp-schedules-6,e47efb57ff33b774,e5a5844112cf2f4a] c.o.o.e.internal.template.HttpTemplate : GET request to agent, url:http://10.79.169.38:62889/api/v1/log/alarms, params:null 2024-12-31 18:35:49.965 ERROR 34018 --- [ocp-schedules-6,e47efb57ff33b774,e5a5844112cf2f4a] o.s.s.s.TaskUtils$LoggingErrorHandler : Unexpected error occurred in scheduled task java.lang.RuntimeException: java.lang.reflect.InvocationTargetException at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:79) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$executeIfNotReadOnly$1(AbstractSchedules.java:133) at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) at com.oceanbase.ocp.common.trace.TraceDecorator.lambda$decorate$0(TraceDecorator.java:33) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.reflect.InvocationTargetException: null at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.oceanbase.ocp.server.common.scheduled.AbstractSchedules.lambda$scheduledTasks$0(AbstractSchedules.java:77) ... 10 common frames omitted Caused by: com.oceanbase.ocp.executor.exception.HttpConnectFailedException: connect to agent failed, ConnectException: Connection refused (Connection refused) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.safeExecute(HttpTemplate.java:498) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.doGet(HttpTemplate.java:217) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.get(HttpTemplate.java:82) at com.oceanbase.ocp.executor.executor.MonitorExecutor.getAlarms(MonitorExecutor.java:51) at com.oceanbase.ocp.compute.agent.manager.HostAgentAlarmManagerImpl.getHostAgentAlarms(HostAgentAlarmManagerImpl.java:62) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl.getHostAgentAlarmsByHost(HostAgentServiceImpl.java:1086) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl$$FastClassBySpringCGLIB$$e7947c56.invoke() at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) at org.springframework.aop.framework.CglibAopProxy.invokeMethod(CglibAopProxy.java:386) at org.springframework.aop.framework.CglibAopProxy.access$000(CglibAopProxy.java:85) at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:703) at com.oceanbase.ocp.compute.agent.HostAgentServiceImpl$$EnhancerBySpringCGLIB$$b664ab35.getHostAgentAlarmsByHost() at com.oceanbase.ocp.server.common.scheduled.HostSchedules.lambda$getHostAgentAlarms$1(HostSchedules.java:105) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:183) at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1384) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) at java.util.stream.ForEachOps$ForEachTask.compute(ForEachOps.java:290) at java.util.concurrent.CountedCompleter.exec(CountedCompleter.java:731) at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) at java.util.concurrent.ForkJoinTask.doInvoke(ForkJoinTask.java:401) at java.util.concurrent.ForkJoinTask.invoke(ForkJoinTask.java:734) at java.util.stream.ForEachOps$ForEachOp.evaluateParallel(ForEachOps.java:159) at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateParallel(ForEachOps.java:173) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:233) at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:485) at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:650) at com.oceanbase.ocp.server.common.scheduled.HostSchedules.getHostAgentAlarms(HostSchedules.java:105) ... 15 common frames omitted Caused by: javax.ws.rs.ProcessingException: org.apache.http.conn.HttpHostConnectException: Connect to 10.79.169.38:62889 [/10.79.169.38] failed: Connection refused (Connection refused) at org.glassfish.jersey.apache.connector.ApacheConnector.apply(ApacheConnector.java:519) at org.glassfish.jersey.client.ClientRuntime.invoke(ClientRuntime.java:297) at org.glassfish.jersey.client.JerseyInvocation.lambda$invoke$2(JerseyInvocation.java:687) at org.glassfish.jersey.client.JerseyInvocation.call(JerseyInvocation.java:697) at org.glassfish.jersey.client.JerseyInvocation.lambda$runInScope$3(JerseyInvocation.java:691) at org.glassfish.jersey.internal.Errors.process(Errors.java:292) at org.glassfish.jersey.internal.Errors.process(Errors.java:274) at org.glassfish.jersey.internal.Errors.process(Errors.java:205) at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:390) at org.glassfish.jersey.client.JerseyInvocation.runInScope(JerseyInvocation.java:691) at org.glassfish.jersey.client.JerseyInvocation.invoke(JerseyInvocation.java:686) at org.glassfish.jersey.client.JerseyInvocation$Builder.method(JerseyInvocation.java:432) at org.glassfish.jersey.client.JerseyInvocation$Builder.get(JerseyInvocation.java:323) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.lambda$doGet$0(HttpTemplate.java:217) at com.oceanbase.ocp.executor.internal.template.HttpTemplate.safeExecute(HttpTemplate.java:489) ... 41 common frames omitted Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 10.79.169.38:62889 [/10.79.169.38] failed: Connection refused (Connection refused) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156) at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376) at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393) at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236) at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:72) at org.glassfish.jersey.apache.connector.ApacheConnector.apply(ApacheConnector.java:471) ... 55 common frames omitted Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:75) at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142) ... 64 common frames omitted 2024-12-31 18:35:50.633 INFO 34018 --- [ocp-async-1,3d1e3d0c063e6bae,c46e5a3a78d80650] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:50.639 WARN 34018 --- [ocp-async-10,ea9d687ded0ef460,b992435d6775bd14] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty. 2024-12-31 18:35:51.568 INFO 34018 --- [prometheus-minute-schedule-1,9506d9dffc2f0b5b,2d235bc2eafe5001] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1735641360, interval=60 2024-12-31 18:35:51.889 INFO 34018 --- [print-time-series-interval60-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:35:51.908 INFO 34018 --- [print-time-series-interval5-1,,] c.o.o.m.a.MonitorAsyncComputeProcessor : Async compute queue max size = 0, current size = 0. 2024-12-31 18:35:52.477 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.79.169.37:8090 refreshes policies... 2024-12-31 18:35:52.479 INFO 34018 --- [pool-11-thread-2,,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0 2024-12-31 18:35:52.633 INFO 34018 --- [ocp-async-7,9d1b257c63d4c541,d8f15fbe53333df3] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents 2024-12-31 18:35:52.639 WARN 34018 --- [ocp-async-3,ae180db0ab5ad20c,60bc054889046c61] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty.